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^This  thesis  demonstrates  Fourier  coefficients  as  a 
reliable  feature  set  for  face  recognition,  using  the 
Autonomous  Face  Recognition  Machine  developed  at  AFIT  over 


the  past  several  years*  j(Routh,  1985;  Russel,  1985;  Smith, 


198ft;  Lambert, _19.8-7^  Sander,  1988). 

^  The  Fourier  transform  portion  of  the  system  was  examined 
and  improved.  The  code  was  made  more  efficient.  Two 
Fourier  transform  routines  (a  fast  Fourier  transform  and  a 
classical  Fourier  transform)  were  tested  and  compared.  A 
voting  scheme  was  incorporated  for  examining  multiple  looks 
at  test  faces.  To  further  demonstrate  performance,  the 
number  of  faces  in  the  data  base  was  doubled. 

Recognition  scores  of  up  to  87%  were  achieved,  compared 
to  63%  for  Sander's  process  with  Fourier  coefficients  as  a 
feature  set  and  67%  for  Lambert's  process  with  a  center-of- 
mass  feature  set,  (Sander,  1988:32). 

This  thesis  includes  complete  system  documentation,  to 
assist  those  doing  further  research  in  this  area.  ( 

'  /x 
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ENHANCED  AUTONOMOUS  FACE  RECOGNITION  MACHINE 


I.  Introduction 


General  Issue 

For  the  past  several  years,  much  effort  has  been  made  at 
the  Air  Force  Institute  of  Technology  to  produce  an 
autonomous  face  recognition  machine.  The  goal  is  for  a 
machine  to  recognize  human  faces  quickly  and  accurately, 
without  human  intervention.  The  current  Autonomous  Face 
Recognition  Machine  (AFRM)  is  the  work  of  many  people, 
including  Routh,  Russel,  Smith,  Lambert,  and  Sander.  A 
brief  history  of  the  development  of  that  machine  follows 
next.  (Routh,  1985;  Russel,  1985;  Smith,  1986;  Lambert, 

1987;  Sander,  1988) 

Background 

Routh *s  Theory  (Routh,  1985) .  Routh  proposed  the  theory 
on  which  the  AFRM  was  based  when  he  published  his  Cortical 
Thought  Theory  (CTT) .  Routh  explored  the  idea  of  a 
"gestalt",  or  essence,  of  an  image  as  that  which  the  human 
brain  saves  to  remember  objects.  He  examined  applications 
in  speech  recognition. 

Russel's  AFRM  (Russel,  1985).  Russel  applied  this  theory 
and  built  the  original  AFRM.  It  was  designed  to  have  a 
computer,  with  a  video  system  attached,  recognize  faces. 
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The  AFRM  was  trained  to  recognize  individuals  by 
processing  four  different  video  images  of  the  same  person’s 
face.  The  presumed  gestalt  of  the  face  was  calculated  and 
saved  in  a  data  base.  Recognition  was  then  accomplished  by 
presenting  still  another  video  image  of  a  face  to  the 
computer.  The  gestalt  for  the  face  was  calculated  and  then 
compared,  using  Euclidean  distance,  to  the  averages  of  the 
gestalts  of  each  person  in  the  data  base  in  an  attempt  to 
identify  the  person. 

The  process  Russel  used  to  form  the  gestalt  from  the 
video  image  is  shown  in  Figure  1.  He  acquired  the  image  of 
a  face  against  a  plain  background.  Face  location  was 
accomplished  by  an  operator  centering  the  face  in  a  frame. 
The  system  could  then  easily  separate  the  face  from  the 
plain  background.  Next,  the  face  image  was  preprocessed  by 
performing  contrast  enhancement.  The  face  was  then  divided 
in  different  ways  to  form  six  windows.  Windowing  was 
necessary  because  thin  symmetric  faces  were  not  separable 
from  wide  symmetric  faces  in  this  system.  Windows  divided 
the  face  into  just  the  left  half,  just  the  right  half,  just 
the  top  half,  and  so  on.  For  each  window,  the  gestalt  was 
calculated.  Russel's  algorithm  for  calculating  the  feature 
set,  or  gestalt,  was  basically  the  two-dimensional  center- 
of-mass  of  the  window,  where  the  darkest  portions  were  given 
the  highest  values.  The  feature  set  for  each  face  therefore 
consisted  of  six  ordered  pairs,  representing  the  coordinates 
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Acquire  Image 

(face  against  plain  background) 


Figure  1.  Russel's  Image  Processing  (Russel,  1985) 
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of  the  center-of-mass  of  each  of  the  six  windows.  This  was 
saved  in  the  data  base. 

Smith's  Improvements  (Smith,  1986).  Russel's  system  was 
limited  by  requiring  a  plain  background  behind  the  face  (to 
assist  in  finding  the  edges  of  the  face)  ana  by  requiring 
human  intervention  (an  operator  had  to  manually  place  the 
face  in  a  frame) .  Smith  eliminated  both  of  these 
restrictions  by  implementing  a  new  face  locator.  The 
process  he  used  is  shown  in  Figure  2.  His  goal  was  to 
locate  faces  in  images  with  varying  backgrounds.  His 
process  looked  for  the  brightness  "signature"  of  various 
facial  features.  For  instance,  if  a  line  is  drawn 
horizontally  across  a  picture  through  a  person's  eyes,  the 
"signature"  shows  two  approximately  equal  dark  spots  with 
brightness  on  either  side  of  each  of  them.  Smith  used  a 
different  set  of  windows  than  Russel,  since  with  the 
uncontrolled  background  he  could  reliably  locate  only  the 
internal  features  of  the  face  and  not  the  edges.  Smith's 
AFRM  did  not  perform  as  well  as  Russell's  system,  resulting 
in  lower  recognition  scores. 

Lambert's  Enhancements  (Lambert,  1987).  Lambert  made 
several  enhancements  to  the  AFRM.  His  process  is  shown  in 
Figure  3 . 

Lambert  improved  the  speed  of  the  system,  primarily  by 
rehosting  it  to  its  current  environment  on  a  Micro-VAX  II. 
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Figure  2.  Smith's  Image  Processing  (Smith,  1986) 
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Figure  3.  Lambert's  Image  Processing  (Lambert,  1987) 
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He  improved  the  recognition  scores  of  the  AFRM  by  revising 
the  front-end  of  the  system,  where  the  face  location  process 
occurs. 

Lambert  developed  a  technique  to  normalize  the  brightness 
of  an  image.  He  used  the  local  brightness  to  adjust  the 
contrast  of  the  image  pixels.  This  allowed  for  variation  in 
the  overall  brightness  of  the  scene. 

Lambert  looked  for  facial  features  which  he  defined  to  be 
two-dimensional  dark  spots,  in  a  specified  size  range, 
surrounded  by  brightness.  He  then  looked  for  features  that 
together  could  form  two  eyes,  a  nose,  and  a  mouth.  This 
method  of  finding  faces  produced  fewer  false  alarms  (that 
is,  declaring  something  to  be  a  face  that  is  not  a  face) 
than  did  Smith's  system.  Finally,  Lambert  drew  an  ellipse 
around  the  putative  internal  features  to  form  a  face.  Where 
Smith  used  the  internal  portions  of  the  face  (features 
only),  Lambert's  ellipse  approximated  the  edges  of  the  face 
and  allowed  more  of  the  face  to  be  processed.  This  gave 
higher  recognition  scores  than  did  Smith's  system.  Lambert 
used  still  another  set  of  windows,  since  his  ellipse  allowed 
him  to  use  more  of  the  actual  face  than  did  Smith's  view. 

To  speed  the  search  for  a  face  in  an  image,  Lambert 
provided  the  option  of  looking  for  a  moving  target.  The 
person  to  be  recognized  moves  into  the  camera  range.  The 
search  for  a  face  is  limited  to  the  area  where  movement  was 
noted. 
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Sander’s  Further  Enhancements  (Sander,  1988) .  In  the 
next  step  in  the  evolution  of  the  AFRM,  Sander  made  further 
improvements  to  the  system.  His  process  is  shown  in 
Figure  4 . 

To  improve  recognition  performance,  Sander  changed  the 
feature  set  to  use  the  coefficients  of  a  two-dimensional 
discrete  Fourier  transform  (2DDFT)  of  each  window  of  the 
face,  instead  of  the  darkness  center-of-mass.  2DDFTs  had 
previously  been  used  successfully  for  other  pattern 
recognition  problems.  Sander  saved  the  DC  component  and  the 
first  and  second  harmonics,  resulting  in  a  5  X  5  array  of 
values  for  each  window,  giving  150  values  for  each  face 
image. 

Sander's  recognition  algorithm  continued  to  use  the 
shortest  Euclidean  distance  between  a  test  image  feature  set 
and  the  trained  face  feature  sets. 

To  reduce  recognition  time  as  the  data  base  of  faces 
grows,  Sander  used  a  back-propagation  neural  network  to 
train  the  data  base  on  faces  and  to  perform  recognition.  If 
successful,  this  would  keep  the  recognition  time  a  constant, 
as  a  result  of  the  distributed  memory  and  computerized 
properties  of  the  network,  regardless  of  the  size  of  the 
data  base.  The  previous  AFRM  would  respond  progressively 
more  slowly  as  the  data  base  of  faces  grew. 
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Figure  4.  Sander's  Image  Processing  (Sander,  1988) 
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Problem  State  *nt 


The  AFRM  is  not  sufficiently  fast  and  accurate,  with  a 
large  number  of  faces,  to  be  of  practical  operational  use. 

Research  Obiectives/Methodoloqy 

In  order  to  make  the  AFRM  run  as  quickly  and  accurately 
as  possible,  with  p  large  number  of  faces,  the  following 
steps  were  taken  in  this  thesis: 

1.  Examine  the  2DDFT  feature  set.  The  substitution  of  a 
Fourier  transform  for  the  center-of-mass  calculation 
did  not  perform  as  well  as  expected  in  the  previous 
thesis  (Sander,  1988:29,30). 

a.  Sander's  2DDFT  program  was  examined  for  possible 
errors,  and  corrections  were  made. 

b.  The  choice  of  the  number  of  windows  and  their 
contents  was  examined  and  reconsidered.  Windows 
were  previously  based  on  the  center-of-mass 
calculation  (Sander,  1988:8,9).  Sander  did  not 
examine  the  choice  of  windows  when  changing  from 
the  center-of-mass  calculation  to  the  use  of 
Fourier  transforms  (Sander,  1988:25). 

c.  Another  Fourier  transform  routine  was  substituted 
for  the  one  used  by  Sander.  System  performance 
and  processing  time  were  evaluated. 

d.  Using  the  third  harmonic,  as  well  as  the  current 
DC  term  and  first  two  harmonics,  was  considered. 
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Improved  performance  was  weighed  against  increased 
processing  time. 

2.  Test  the  AFRM  with  more  faces.  This  system  had 
previously  only  been  trained  to  recognize  24  faces 
(Sander,  1988:29).  The  data  bases  were  expanded  and 
the  system  tested  with  50  faces. 

3.  Test  the  use  of  multiple  images  of  a  person  for 
recognition.  Experiments  were  run  with  the  AFRM 
taking  multiple  looks  at  a  person,  with  a  voting 
scheme  for  resolution.  Improved  performance  was 
weighed  against  increased  processing  time. 

4.  Improve  system  documentation.  The  user's  manual  was 
updated  and  expanded  (Appendix  A) .  Complete  system 
documentation  was  developed  (Appendices  A,  B,  and  C) , 
to  assist  further  research  on  the  AFRM. 

Assumptions 

Sander's  assumptions  were  not  changed  in  this  thesis. 

They  are  as  follows: 

1.  The  subject (s)  are  looking  squarely  at  the  camera 
(the  head  is  not  tilted  or  rotated. 

2.  The  subject (s)  are  not  wearing  glasses. 

3.  The  subject (s)  have  relaxed  expressions  (the  face  is 
not  deliberately  contorted) . 

4.  Four  pictures  are  sufficient  to  characterize  a 
person  in  the  data  base.  (Sander,  1988:2) 
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Standards 


Sander's  standards  were  not  changed  in  this  thesis.  They 
are  standards  that  have  been  net,  and  must  continue  to  hold 
as  enhancements  are  made  to  the  AFRM.  The  standards  are  as 
follows: 

1.  The  AFRM  should  demonstrate  "human  like" 
classification  of  faces. 

2.  Recognition  performance  of  the  AFRM  must  remain  at 
least  as  good  as  that  obtained  by  Russel. 

3.  No  operator  interaction  is  allowed  in  the  face 
location,  windowing,  and  recognition  processes. 

4.  The  AFRM  should  be  able  to  process  scenes  with  a 
random,  uncontrolled  background. 

5.  The  AFRM  must  be  able  to  process  scenes  with 
multiple  faces  in  them.  (Sander,  1988:2-3) 

The  term  "human  like"  implies  success  or  failure  during 
the  recognition  process  that  would  reflect  the  capability  of 
a  human  observer  of  the  same  data. 

Scope/Limitations 

The  scope  of  this  thesis  was  to  meet  the  research 
objectives  previously  described.  The  2DDFT  was  examined, 
corrected,  and  enhanced  to  assure  proper  recognition 
performance.  The  system  was  tested  against  a  larger  data 
base  of  people.  The  recognition  portion  of  the  system  was 
changed  to  incorporate  a  voting  scheme  using  multiple  test 
images  of  a  face.  System  performance  for  each  modification 
was  weighed  against  processing  time.  Documentation  of  the 
entire  system  was  developed.  No  other  suggested 
improvements  to  the  AFRM  were  addressed  in  this  thesis. 
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Equipment 

The  followina  equipment  was  used  for  this  thesis: 

X.  Micro-VAX  Computer  System 

2.  Imaging  Technology  Series  100  Image  Processing  Board 

3.  Sander's  and  Lambert's  Computer  Files  (listed  in 
Appendix  A) 

4 .  Dage  650  Video  Camera 

5.  Panasonic  WV-5490  Monochrome  Monitor 

6.  Tektronix  4632  Video  Hard  Copy  Unit 

7.  MicroVMS  Version  4.6 

8.  VAX  C  Version  2.4 

9.  ITEX  Software  Version  1.2 

Support 

Support  was  needed  from  Systems  Engineering  throughout 
this  research.  Support  was  also  needed  from  fellow  students 
and  others  at  AFIT  to  allow  me  to  take  their  pictures  to 
increase  my  data  base  of  faces. 

gu.Miary. 

This  chapter  provided  a  brief  background  and  summary  of 
the  work  that  preceded  this  thesis  effort.  Details  can  be 
found  in  each  contributor's  dissertation  or  thesis.  This 
background  formed  the  basis  for  this  research  project. 

The  parameters  of  this  thesis  were  defined  by  the  problem 
statement,  research  objectives/methodology,  assumptions, 
standards,  scope/limitation,  equipment,  and  support. 
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The  remaining  chapters  of  this  thesis  describe  further 
evaluation  and  enhancements  to  the  AFRM.  Chapter  2 
discusses  the  methodology  used  for  this  effort,  and  Chapter 
3  explains  the  implementation  techniques.  In  Chapter  4.  the 
results  of  this  thesis  are  given.  Chapter  5  gives 
conclusions  of  the  research  and  recommendations  for  further 
study. 
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Introduction 

This  is  the  fifth  thesis  research  effort  in  the 
development  of  the  AFIT  AFRM,  and  as  the  total  research 
effort  is  very  large,  there  are  likely  to  be  subsequent 
efforts  to  make  the  AFRM  a  practical,  operating  system. 

Previous  work  using  the  substitution  of  a  Fourier 
transform  for  the  center-of-mass  calculation  did  not  perform 
as  well  as  expected  (Sander,  1988:29,30).  A  working  feature 
set  for  faces  is  critical  to  the  face  recognition  process; 
therefore,  examination  and  correction  of  the  use  of  Fourier 
coefficients  as  a  feature  set  was  a  next  logical  step. 

Adding  faces  to  the  database  was  also  an  important  step. 
Making  the  data  base  as  large  as  possible  helps  to  prove 
that  the  concepts  behind  the  system  are  sound. 

Multiple  looks  at  a  person's  face,  that  is  multiple  face 
images,  with  some  sort  of  averaging  or  voting  scheme,  were 
added  in  an  attempt  to  improve  recognition  performance. 

Previous  research  efforts  included  little  system 
documsntation.  Each  succeeding  researcher  spends  increasing 
amounts  of  time  examining  the  preceding  work  and  figuring 
out  what  the  program  does  and  how  it  does  it.  Time  taken  to 
document  the  system  was  an  important  part  of  this  thesis. 

It  will  save  follow-on  research  efforts  precious  time  in 
reviewing  the  AFRM  program  and  associated  files. 


15 


Feature  Set 


Justification  of  Method  Selected.  "Finding  an 
appropriate  feature  set  is  one  of  the  most  difficult  tasks 
in  the  pattern  recognition  process"  (Sander,  1988:22). 

Sander  briefly  supports  the  choice  of  Fourier  coefficients 
as  a  feature  set.  Additional  support  can  be  found  in  the 
literature: 

"Transform  theory  has  played  a  key  role  in  imago 
processing  for  a  number  of  years,  and  it  continues  to  bo 
a  topic  of  interest  in  theoretical  as  we.’tl  as  applied 
work  in  this  field.  Two-dimensional  transforms  are  used 
. . .  for  image  enhancement,  restoration,  encoding,  and 
description."  (Gonzalez  and  Wintz,  1977:36) 

"The  discrete  Fourier  transform  often  proves  to  be  a 
powerful  tool  for  the  characterization  of  picture 
signals,  the  analysis  of  imaging  systems,  and  the  design 
of  algorithms  for  image  signal  processing."  (Wahl, 
1987:36) 

Several  applications  of  image  processing  are  given,  such 
as  analysis  of  fingerprints  (Gonzalez  and  Wintz,  1977:xiii; 
Wahl,  1987:1)  and  face  profile  processing  (Wahl,  1987:1). 
Fourier  coefficients  have  been  used  as  a  feature  set  in 
research  here  at  AFIT,  with  much  success  in  alphabet 
analysis  (Bush,  1977)  and  text  recognition  (O'Hair,  1984). 

Sander  chose  the  coefficients  of  a  2DDFT  (two-dimensional 
discrete  Fourier  transform)  as  the  feature  set,  specifically 
an  FFT  (fast  Fourier  transform).  The  use  of  an  FFT 
significantly  reduces  the  number  of  calculations  required  to 
complete  the  transform,  compared  to  a  classical  Fourier 
transform  calculation  (Gonzalez  and  Wintz,  1977:79,  Wahl, 
1987:41-42) . 
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Research  Methodology.  Sander’s  test  results  with  the  FFT  as 
a  feature  set  were  disappointing.  "Better  recognition  was 
cxoected  from  FaceDFT."  (Sander,  1988:30) 

In  an  attempt  to  demonstrate  the  2DDFT  as  a  good  feature 
set  for  faces,  this  researcher  examined  Sander’s  program  for 
possible  errors.  The  code  was  chocked  to  verify  that  the 
inputs  to  the  Fourier  transform  were  correct.  The  outputs 
of  the  Fourier  transform,  saved  in  the  feature  set  file, 
were  checked  to  make  sure  that  the  correct  values,  the  DC 
component  and  first  and  second  harmonics,  were  the  values 
saved. 

Finally  the  transform  subroutine  itself  was  explored.  No 
citation  was  given  for  the  transform  routine  although  "an 
already  existing  routine  was  used"  (Sander,  1988:25).  The 
source  of  the  code  has  since  been  discovered  to  be  an  AFIT 
doctoral  student  (Fretheim,  1988).  Freitheim  confirmed  that 
his  code  had  been  thoroughly  tested  (Fretheim,  1989). 

Sander's  tests  were  then  rerun  to  verify  the  results. 
Since  the  results  of  the  retest  were  not  the  same  as 
Sander's  published  results,  it  was  assumed  that  some 
parameter  of  his  experiments  had  changed;  most  likely  the 
face  images  he  left  in  his  directories  are  not  the  ones  he 
used  for  testing. 

Freitheim 's  Fourier  transform  program  is  an  FFT  (fast 
Fourier  transform) ,  which,  as  mentioned  before,  runs  much 
faster  than  a  classical  transform  by  reducing  the  number  of 
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required  calculations.  The  input  array  must  have  dimensions 
that  are  a  power  of  two.  Sander's  input  array  to  the  FFT 
was  always  128  X  128.  Since  faces  vary  in  size,  any  unused 
portions  of  the  array  were  filled  with  zeros.  This  gives 
good  results  a«  long  as  a  large  portion  of  the  array  is 
filled  with  data  and  not  zeros,  since  only  the  DC  component 
and  two  harmonics  were  saved.  An  examination  of  the  code 
shoved  that  the  input  data  was  never  larger  than  64  X  64, 
meaning  that  one-fjurth  or  less  of  the  input  array  of  the 
FFT  was  used  for  actual  data. 

It  was  also  noted  that  in  filling  these  input  arrays,  in 
preparation  for  the  transform,  often  every  other  pixel  from 
the  image  was  used.  This  saves  processing  time  with  little 
or  no  effect  on  the  accuracy  of  the  result  (Kabrisky,  1989) . 

The  code  was  changed  to  use  a  64  X  64  array  as  input  to 
the  FFT.  Where  the  use  of  every  other  pixel  resulted  in  32 
or  less  values  along  a  dimension,  tko  code  was  changed  to 
use  every  pixel,  to  better  fill  the  array  with  true  data. 

All  face  images  were  then  rerun  to  recalculate  their  feature 
sets,  and  all  faces  were  tested  to  reevaluate  AFRM 
performance. 

Since  this  method  still  did  not  completely  fill  the  input 
array  (faces  vary  in  size),  a  classical  Fourier  transform 
was  used,  which  could  intrinsically  compute  the  transform  of 
data  files  of  arbitrary  dimensions  and  does  not  require 
input  array  dimensions  to  be  a  power  of  two.  Normally,  a 
classical  Fourier  transform  results  in  a  much  slower 
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program.  However,  since  the  Fourier  transform  routine  need 
only  calculate  the  DC  component  plus  two  harmonics,  some 
processing  speed  could  be  regained.  Another  AFIT  doctoral 
student  provided  such  a  routine  (O'Hair,  1989),  which  was 
implemented  in  the  AFRM,  replacing  the  FFT.  Tests  of  all 
faces  were  rerun  and  performance  compared  to  the  FFT. 

Another  research  objective  in  examination  of  the  feature 
set,  was  to  evaluate  the  utility  of  particular  windows. 

Since  the  program  allows  the  six  windows  of  the  face  to  be 
weighted  (the  default  is  to  weight  them  all  equally) ,  each 
window  was  run  alone,  to  see  if  perhaps  one  window  gave  the 
same  results  (or  better)  than  the  whole  system.  Then  only 
that  window  would  be  needed  in  feature  set  calculations, 
saving  processing  time. 

The  choice  of  window  location  and  size  was  reevaluated. 
Windows  were  originally  chosen  considering  a  center-of-mass 
feature  set,  and  not  reconsidered  with  the  substitution  of 
the  Fourier  transform  (Sander,  1988:  25) .  Further  research 
showed  that  these  windows  were  originally  chosen  because 
humans  found  these  to  be  good  windows  for  face  recognition 
(Lambert,  1987:2-12).  This  choice  of  windows  seems  to  be  a 
good  method  and  turns  out  not  to  be  related  to  the  center- 
of-mass  calculation  algorithm.  Therefore,  the  window 
contents  were  not  changed  in  this  thesis. 

The  final  research  objective  in  this  area  was  to  consider 
adding  coefficients  of  the  third  harmonic  of  the  Fourier 
Transform  to  the  feature  set,  weighing  increased  processing 
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time  against  improved  performance.  The  increased  processing 
time  would  not  only  occur  in  the  calculation  of  the 
transform,  but  also  in  the  time  needed  to  actually  recognize 
faces.  When  using  a  neural  network  for  recognition,  Sander 
found  the  processing  time  (using  a  locally  available 
computer)  with  the  third  harmonic  to  be  prohibitive  (Sander, 
1988:31).  Since  the  recognition  performance  was  improved 
significantly  with  the  other  modifications  described  in  this 
thesis,  the  third  harmonic  was  not  needed  as  part  of  the 
feature  set. 

Increasing  Data  Base  Size 

"A  higher  dimensioned  feature  vector  should  improve  the 
recognition  capabilities  of  the  system,  by  increasing  the 
separation  of  the  template  vectors  stored  for  each  person" 
(Sander,  1988:2).  This  increased  separation  should  mean 
that  the  AFRM  can  run  with  comparable  performance  with  a 
larger  data  base  of  faces. 

The  AFRM  was  previously  tested  with  24  faces  (Sander, 
1988:29).  In  this  thesis,  the  data  base  was  increased  to  50 
faces. 

Multiple  Looks 

Trained  face  values  are  the  average  of  the  feature  sets 
of  four  different  images  of  a  person's  face.  This  helps  to 
smooth  the  data,  hopefully  finding  the  middle  of  the  range 
of  values  for  each  feature  set  entry.  Test  face  values, 
however,  only  use  one  face  image  and  therefore  only  one  set 
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of  features.  An  averaging  strategy  is  also  logical  for  the 
recognition  process,  so  multiple  looks  at  a  face,  with  some 
sort  of  averaging  or  voting,  was  examined. 

As  new  people  were  added  to  the  data  base,  additional 
images  were  taken  to  allow  for  a  voting  strategy.  A  total 
of  eight  pictures  of  each  individual  were  taken,  the  four 
needed  for  training  and  four  for  voting. 

After  training  the  AFRM  for  the  new  people,  each  of  the 
four  test  images  was  tested  individually  against  the 
training  data  base.  The  results  were  examined  manually  to 
see  if  voting  was  likely  to  improve  recognition  performance. 

Next  the  four  feature  sets  for  the  four  test  images  for 
each  person  were  averaged  in  the  same  way  training  feature 
sets  are  handled.  This  average  feature  set  for  each  test 
face  was  then  tested  against  the  training  data  base  and 
performance  measured  and  examined. 

Documentation 

Justification  of  Method  Selected.  Proper  documentation 
is  critical  in  any  system  that  is  to  be  maintained. 

"Programs  are  not  used  once  and  discarded,  nor  are  they  run 
forever  without  change.  They  evolve"  (Kernighan  and 
Plauger,  1978:25).  The  research  on  face  recognition  is  not 
complete;  therefore,  it  is  likely  that  the  programs 
developed  in  this  and  preceding  theses  will  continue  to 
evolve . 


21 


Documentation  is  particularly  important  when  those 
maintaining  a  program  are  not  those  who  developed  it. 
(Kernighan  and  Plauger,  1978:64-65).  Comments  can  provide 
important  information  to  help  someone  understand  the  intent 
of  the  program  (Pressman,  1982:421).  The  AFRM  software  is 
written  in  the  C  programming  language,  which  with 
capabilities  such  as  complex  data  structures,  requires  the 
programmer  to  "comment  anything  that  is  not  obvious" 

(Darnell  and  Margolis,  1988:27). 

Lack  of  documentation  causes  follow-on  researchers  to 
spend  excessive  resources  understanding  the  work  that 
preceded  them.  Also  without  documentation,  the  researcher 
may  misunderstand  complex  code  and  make  changes  that  have 
unintended  effects  on  the  operation  of  the  system.  A  lot  of 
time  is  then  wasted  in  debugging  the  program. 

Research  Methodology.  Lambert's  User  Manual  (Lambert, 

1987 : Appendix  C)  was  updated  and  included  in  this  thesis  as 
Appendix  A.  The  first  chapter,  which  discusses  normal 
operation  of  the  AFRM,  required  only  a  few  modifications  to 
reflect  additions  and  changes  to  the  user's  view  of  the 
AFRM.  The  second  chapter,  which  covers  information  for  the 
AFRM  maintainer  or  developer,  was  expanded  substantially. 
Important  file  name  linkages  were  explained.  A  full  listing 
of  system  files  was  added,  with  descriptions  of  those  files. 
Also,  a  full  listing  of  system  files  left  by  Sander  was 
included,  also  with  descriptions  of  those  files,  many  of 
which  may  still  be  of  use. 
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Appendix  B  gives  a  detailed  list  of  all  changes  made  to 
Sander's  FACEDFT  program  for  this  thesis.  Many  changes  were 
needed  to  make  the  program  run  correctly  and  to  make  the 
menus  and  messages  consistent  and  more  meaningful.  Many 
changes  were  of  a  software  engineering  nature,  making  the 
code  more  readable  and  maintainable.  Warnings  are  given  for 
potential  problems  discovered  but  not  changed.  Some  changes 
were  not  made  because  drastic  changes,  for  documentation 
proposes  but  not  much  affecting  the  execution  of  the 
application,  would  make  it  difficult  for  those  trying  to 
follow  the  development  of  code  from  one  thesis  to  another. 
Finally  changes  were  made  to  the  program  to  correct  and 
enhance  the  Fourier  transform  processing  as  described  in  a 
previous  section  of  this  chapter. 

The  documentation  for  the  program  FACEDFT  is  given  in 
Appendix  C.  Sander  wrote  three  versions  of  the  face 
program:  FACEDFT  implements  the  FFT  only,  FACENET  implements 
the  neural  network  only,  and  FACENETDFT  implements  both  the 
FFT  and  the  neural  network  (Sander,  1988:Appendix  A).  This 
thesis  deals  only  with  changes  to  FACEDFT.  However,  many 
subroutines  are  duplicated  in  these  multiple  versions. 
Therefore,  documentation  that  is  traditionally  included  in 
the  program  as  comments  is  provided  here  as  a  separate 
appendix.  Future  research  may  use  any  of  these  versions  of 
the  face  program.  The  documentation  in  Appendix  C,  while 
specific  to  FACEDFT,  should  be  very  useful  when  dealing  with 
the  other  versions.  The  documentation  contains  a  list  of 
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all  of  the  many  external  files  used  by  the  program,  with 
descriptions  of  those  files'  contents.  Naming  conventions 
for  those  files  are  given.  The  linkage  of  the  program  to 
those  files,  via  DEFINE  statements,  is  described. 

References  to  external  libraries,  needed  to  link  edit  the 
program,  is  discussed.  The  major  global  variables  are 
described.  Finally,  high-level  pseudo-coda  for  the  entire 
program  is  provided. 

Appendix  D  gives  the  final  program  listing  for  the 
FACEDFT  program. 

Appendix  E  gives  substitution  code  to  use  the  classical 
Fourier  transform  in  place  of  the  FFT. 

Summary 

This  chapter  described  the  changes  made  to  the  AFRM  for 
this  research  effort,  listing  those  changes  and  giving  the 
rationale  behind  them.  The  next  chapter  discusses  how  these 
changes  were  implemented. 
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III.  Implementation 


Introduction 

The  implementation  of  the  changes  described  in  the 
previous  chapter  was  done  in  an  evolutionary  fashion.  Most 
of  these  modifications  could  be  made  incrementally,  allowing 
each  to  be  coded,  tested,  and  evaluated  separately. 

Feature  Set 

Changes  were  made  carefully  and  incrementally  to  the 
Fourier  transform  portion  of  the  program.  First  the 
existing  code  was  studied  and  tests  run  on  that  system. 

Next,  changes  were  made  to  correct  and  enhance  the  existing 
Fourier  transform  (FFT) .  In  parallel,  new  faces  were  added 
to  the  system.  Then  tests  were  run  on  all  faces. 

Performance  for  previous  faces,  new  faces,  and  the 
combination  of  all  faces  could  then  be  examined.  Next  the 
existing  Fourier  transform  routine  was  replaced  with  a 
classical  Fourier  transform.  Tests  on  all  faces  were 
repeated.  Once  again,  performance  was  evaluated  on  all 
faces,  combined  and  separated  into  old  and  new. 

The  program  is  documented  to  allow  future  researchers  to 
choose  the  enhanced  FFT  or  the  classical  Fourier  transform. 

Sander's  software  versions  still  exist  on  backup  tape. 
This  includes  his  original  version  of  the  FFT  as  a  feature 
set,  a  version  that  uses  a  Neural  Network  for  recognition, 
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and  a  version  that  combines  the  FFT  feature  set  and  Neural 
Network.  This  allows  comparisons  to  still  be  made  between 
Sander's  feature  set  and  the  two  feature  set  variations  used 
in  this  thesis.  (This  also  allows  work  to  be  continued  on 
the  Neural  Network  at  a  future  date.) 

Increasing  Data  Base  size 

As  soon  as  Sander's  system  was  evaluated,  new  faces  were 
added  to  the  system,  so  that  the  larger  data  base  would  be 
available  to  evaluate  all  changes  to  the  AFRM. 

Multiple  Looks 

Voting  was  looked  at  whenever  testing  with  new  faces. 

This  testing  could  not  be  done  on  face  images  left  by 
previous  researchers,  because  there  weren't  sets  of  four 
test  images  per  person  to  use  for  voting.  Voting  was 
examined  for  the  changed  version  of  the  FFT  coefficients 
feature  set  and  the  classical  Fourier  transform  coefficients 
feature  set,  on  new  faces  added  to  the  system. 

The  code  for  voting  was  marked  by  comments,  making  it 
easy  to  choose  to  use  the  voting  scheme  or  not. 

Documentation 

The  documentation  was  also  done  in  an  evolutionary 
fashion.  The  first  cut  covered  that  part  of  the  code  that 
had  to  be  understood  to  start  research  on  the  other  thesis 
objectives.  The  documentation  was  corrected  and  expanded  as 
work  progressed  on  those  other  objectives.  Finally, 
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remaining  gaps  were  filled  in  to  provide  as  complete  a  set 
of  documentation  as  possible. 

Many  errors  and  potential  problems  were  found  and 
corrected.  These  are  listed  in  Appendix  B.  Some  potential 
problems  were  noted  but  not  corrected.  Appendix  B  lists 
these  as  warnings  and  give  workarounds  where  possible. 

The  overall  structure  of  the  program,  variable  names, 
etc.,  were  left  intact,  to  avoid  loss  of  continuity  with 
previous  and  parallel  versions  of  the  program.  This  meant 
leaving  inconsistencies  in  the  structure  of  the  code, 
particularly  noticeable  in  MENU1,  where  some  processes  are 
broken  out  into  subroutines  while  some  rather  long  processes 
are  included  inline.  This  also  meant  leaving  such 
unmeaningful  names  as  MENU1,  MENU2,  MEMU3 ,  sx,  sy,  and  many 
more. 

Documentation  of  the  material  left  by  Sander  is  given  in 
the  User's  Manual  (Appendix  A). 

Summary 

This  chapter  described  how  the  changes  described  in 
Chapter  2  were  implemented  in  the  AFRM.  The  next  chapter 
examines  the  results  of  these  changes. 
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IV.  Results 


Introduction 

This  chapter  presents  the  results  of  this  thesis 
research.  Results  are  compared  to  previous  theses  where 
applicable. 

Feature  Set 

Sanders  Results.  Sander's  FACEDFT  program  and  data  were 
retested  for  comparison  with  his  results.  Table  1  shows  the 
results  of  these  tests.  The  FACE  column  shows  the 
performance  Sander  obtained  when  testing  his  data  against 
Lambert's  program.  The  AFRM  recognized  16  of  24  people,  or 
67%.  The  FACEDFT  column  gives  the  results  of  Sander's  FFT 
version  against  that  same  data,  where  15  of  24  people,  or 
63%,  were  correctly  recognized. 

Sander  proposed  that  some  of  the  problem  may  be  that 
Fourier  transforms  are  more  sensitive  to  tilt  than  are  the 
center-of-mass  calculations  used  by  Lambert  (Sander, 
1988:30).  However,  in  adding  more  faces  to  the  data  base, 
it  was  found  that  the  face  location  algorithm  was  very 
sensitive  to  tilt.  Therefore  faces  with  tilt  are  pretty 
much  eliminated  by  the  face  locator  and  never  have  feature 
sets  calculated.  This  researcher  does  not  believe  that  tilt 
explains  the  disappointing  performance  of  the  Fourier 
transform  in  the  AFRM. 
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Table  1. 


Comparison  of  FACE  and  FACEDFT 


Name 

Statistics  from 
Sander  Thesis 
(Sander, 

1988:32) 

i 

Rerun  of 

FACEDFT  Test 

FACE 

FACEDFT 

Retest 
Ver  1 

of  FACEDFT 

Ver  2  Ver  3 

rmaple 

2 

y 

y 

mkabrisky 

2 

14 

2 

mlambert 

y 

y 

y 

llambert 

y 

y 

y 

y 

d 1 amber t 

2 

2 

2 

srogers 

y 

y 

y 

ecrawford 

y 

4 

4 

mmayo 

y 

y 

y 

jsillart 

y 

y 

y 

dbane 

2 

y 

y 

druck 

y 

3 

3 

kcox 

y 

2 

2 

3  2 

efretheim 

y 

y 

y 

y  y 

lroberts 

3 

y 

y 

y 

mdrylie 

y 

7 

y 

gtarr 

y 

y 

y 

y 

csabick 

y 

y 

y 

mohair 

y 

2 

4 

y  y 

ppleva 

2 

5 

V 

dbridges 

4 

y 

y 

y 

ddoak 

y 

y 

y 

glorimor 

6 

y 

y 

rmorales 

y 

y 

y 

y 

gdawson 

y 

14 

y 

key:  -  y  weans  yes,  face  recognized  correctly  (first  choice) 

-  number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 

-  >15  means  correct  person  not  in  list  of  top  15 
choices 
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Re tost  of  sender.  Data .  The  remainder  of  Table  1  shews  a 


retest  of  Sander's  program  and  Sander's  data.  Where 
multiple  test  images  existed,  all  were  used,  with  simple 
voting,  as  there  was  no  way  of  knowing  which  Sander  may  have 
used.  The  retest  results  are  not  identical  to  Sander's 
tost,  recognizing  19  of  24  people.  It  is  assumed  that  some 
parameter  of  his  experiments  changed  between  theses;  nost 
likely  the  face  images  left  by  Sander  are  not  the  same  used 
by  him  for  his  testing.  It  was  decided  to  ignore  these 
retest  results  since  the  parameters  of  the  test  were  not 
well  understood.  Recognition  performance  in  this  thesis  is 
compared  only  with  the  results  Sander  claims. 

At  the  same  time,  the  faces  were  retested  using  each 
window  alone.  Previously  all  windows  were  combined  and 
weighted  equally  for  recognition  calculations.  These  tests 
were  run  before  it  was  realized  that  the  source  of  the  data 
could  not  be  traced.  The  results  of  the  individual  window 
testing  are  shown  in  Table  2,  with  the  combined  test  also 
presented  for  comparison.  No  single  window  showed  superior 
performance.  Regardless  of  the  source  of  the  data,  it 
appears  that  combining  all  six  windows  gives  the  best 
feature  set  for  faces. 

Test  of  Modified  FACEDFT.  Table  3  shows  the  results 
obtained  when  testing  the  program  with  the  modified  FACEDFT 
program.  This  is  the  version  where  the  input  array  to  the 
Fourier  transform  is  64  X  64  and  that  array  is  filled  as 
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Table  2.  Comparison  of  FACEDFT 
And  Individual  Windows 


Name 

Ver 

Rerun  of 
FACEDFT 

Rerun  of  FACEDFT 
with  single  window 

test 

1 

2 

3 

4 

5 

6 

rmaple 

1 

y 

y 

y 

y 

y 

y 

y 

mkabrisky 

1 

2 

4 

3 

6 

3 

y 

y 

mlambert 

1 

y 

y 

4 

y 

y 

y 

y 

llambert 

1 

y 

y 

y 

y 

2 

2 

y 

2 

y 

y 

y 

y 

2 

2 

y 

dlambert 

1 

2 

y 

y 

3 

y 

2 

2 

srogers 

1 

y 

y 

y 

y 

y 

y 

y 

ecrawford 

1 

4 

4 

9 

9 

2 

2 

3 

mmayo 

1 

y 

y 

y 

y 

y 

y 

y 

jsillart 

1 

y 

2 

2 

2 

y 

y 

y 

dbane 

1 

y 

y 

y 

y 

y 

y 

y 

druck 

1 

3 

4 

4 

4 

2 

3 

3 

Rcox 

1 

2 

2 

4 

2 

y 

6 

2 

2 

3 

3 

4 

4 

2 

5 

2 

3 

2 

y 

2 

2 

2 

4 

2 

efretheim 

1 

y 

y 

y 

y 

2 

y 

y 

2 

y 

y 

y 

y 

y 

y 

y 

3 

y 

y 

y 

y 

2 

y 

y 

lroberts 

1 

y 

3 

2 

y 

y 

y 

2 

2 

y 

2 

y 

y 

y 

y 

y 

mdrylie 

1 

y 

y 

y 

y 

2 

y 

y 

gtarr 

1 

y 

y 

y 

y 

y 

y 

y 

2 

y 

y 

y 

y 

y 

y 

y 

csabick 

1 

y 

y 

y 

y 

y 

y 

y 

mohair 

1 

4 

5 

3 

7 

y 

2 

10 

2 

y 

2 

3 

y 

4 

2 

y 

3 

y 

y 

y 

3 

y 

y 

5 

ppleva 

1 

y 

3 

y 

3 

2 

y 

y 

dbrrdges 

1 

y 

3 

y 

y 

3 

y 

2 

2 

y 

3 

y 

y 

3 

y 

2 

ddoak 

1 

y 

y 

y 

y 

y 

3 

3 

gloriwor 

1 

y 

y 

y 

y 

y 

y 

y 

rmorales 

1 

y 

y 

y 

y 

y 

y 

y 

2 

y 

y 

3 

y 

3 

y 

y 

gdawson 

1 

y 

y 

2 

y 

y 

y 

y 

key:  -  y  means  yes,  face  recognized  correctly  (first  choice) 

-  number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 

-  >15  means  correct  person  not  in  list  of  top  15 
choices 
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Table  3 


Changed  r'ACEDFT 


Name 

Ver  1 

Ver  2 

Ver  3 

Ver  4 

Averaged 

mkabrisky 

y 

y 

y 

y 

y 

mmaneelv 

y 

y 

y 

2 

y 

rfiler 

y 

y 

y 

y 

y 

vmilholen 

y 

y 

y 

y 

y 

wrecla 

y 

y 

y 

y 

y 

pvhalen 

3 

y 

y 

y 

y 

jbrill 

y 

y 

y 

y 

y 

rjackson 

9 

5 

6 

5 

y 

mreinig 

7 

y 

2 

y 

y 

jhamilton 

5 

5 

15 

15 

7 

rricart 

>15 

10 

10 

>15 

10 

ssablnn 

y 

y 

y 

y 

y 

dbossert 

y 

y 

y 

y 

y 

thamilton 

Y 

y 

2 

6 

2 

chogan 

2 

y 

y 

y 

y 

rsmith 

10 

>15 

9 

7 

6 

tmanely 

y 

y 

y 

y 

y 

pmarshall 

y 

y 

y 

y 

y 

jlong 

>15 

>15 

>15 

>15 

>15 

mleahy 

y 

y 

y 

y 

y 

syarost 

5 

7 

y 

y 

y 

tdavis 

y 

y 

y 

y 

y 

mjohnson 

y 

y 

y 

2 

y 

dumphress 

5 

4 

4 

4 

3 

jsrubar 

2 

y 

2 

y 

y 

fbrown 

2 

y 

y 

y 

y 

brobb 

y 

y 

y 

>15 

y 

gmiracle 

y 

y 

y 

y 

y 

ssheldon 

y 

y 

y 

y 

y 

sberger 

y 

y 

y 

y 

y 

sfiler 

y 

y 

y 

y 

y 

bconway 

y 

y 

y 

2 

y 

dbarr 

y 

y 

y 

y 

y 

kfife 

y 

y 

y 

y 

y 

key:  -  y  means  yes,  face  recognized  correctly  (first  choice) 

-  number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 

-  >15  means  correct  person  not  in  list  of  top  15 
choices 
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Table  3.  Changed  FACEDFT  (continued) 


Name 

Ver  1  Ver  2  Ver  3 

rmaple 

y  y  y 

mlambert 

3 

dlambert 

y 

srogers 

y 

ecrawford 

6 

*  mmayo 

y 

jsillart 

y 

dbane 

y  2  y 

*  druck 

>15 

kcox 

7 

mdrylie 

4 

gtarr 

y  y 

mohair 

3  y 

dbridges 

2  2 

glorimor 

y 

rmorales 

y  y 

y  means  yes,  face  recognized  correctly  (first  choice) 
number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 
>15  means  correct  person  not  in  list  of  top  15 
choices 


much  as  possible  with  actual  data  >ther  values  are  set  to 
zero).  This  table  is  divided  into  two  sections,  one  for  the 
faces  added  in  this  thesis  and  one  for  the  previously 
digitized  faces. 

It  was  necessary  to  reprocess  the  previously  digitized 
faces  to  calculate  their  feature  sets  with  the  altered 
program.  This  portion  of  the  data  base  now  contains  only  16 
faces,  rather  than  the  previous  24.  Eight  faces  could  not 
be  successfully  reprocessed,  as  the  face  locator  could  not 
find  four  face  images  to  use  for  training.  These  eigne  secs 
of  faces  were  discarded  and  34  new  people  added  to  total  50 
faces. 

Performance  of  the  change  to  Sander's  code  alone  can  be 
evaluated  for  the  added  faces  by  supposing  only  one  test 
image  was  taken,  say  version  1,  and  then  considering  those 
results . 

The  previously  digitized  faces  still  used  simple  voting, 
resulting  in  a  tie  for  mohair. 

The  tabulated  results  are  shown  in  Table  4,  lines  a,  b, 
and  c.  The  recognition  performance  is  in  the  same  range  as 
those  seen  by  Sander. 

The  processing  time  for  the  classical  Fourier  transform 
was  compared  to  the  FFT.  This  was  done  informally,  while 
watching  the  AFRM  recalculate  features  sets,  since  an 
approximate  comparison  was  all  that  was  needed.  There  was 
no  noticeable  difference  in  the  time  needed  to  calculate 
feature  sets. 
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Table  4.  Tabulated  Results 


Modified  FACEDFT 


50  faces 

Raw  Score 

Percentage 

a) 

Previously  digitized  faces 

9  or  10/16 

56  or  63 

b) 

c) 

Added  faces  ver  l 

Combined  with  existing  faces 

22/34 

31  or  32/50 

65 

62  or  64 

d) 

e) 

Added  faces  simple  vote 
Combined  with  existing  faces 

27  or  28/34 
36  or  38/50 

79  or  82 
72  or  76 

f) 

g) 

Added  faces  averaged 

Combined  with  existing  faces 

28/34 

37  or  38/50 

82 

74  or  76 

45  faces 

( revision  of  above  scores) 

Raw  Score 

Percentage 

h) 

Previously  digitized  faces 

8  or  9/14 

57  or  64 

i) 

j) 

Added  faces  ver  1 

Combined  with  existing  faces 

22/31 

30  or  31/45 

71 

67  or  69 

k) 

l) 

Added  faces  simple  vote 
Combined  with  existing  faces 

27  or  28/31 

35  or  37/45 

87  or  90 
78  or  82 

m) 

n) 

Added  faces  averaged 

Combined  with  existing  faces 

27/31 

35  or  36/45 

87 

78  or  80 

Note:  Where  voting  schemes  result  in  a  tie,  two  scores  are 
given  separated  by  "or".  The  higher  score  is  for  the  tie 
counting  as  recognition  and  the  lower  score  is  for  the  tie 
counting  as  failure  to  recognize. 


35 


Table  4. 


Tabulated  Results  (continued) 


faceft 


50  faces 

Raw  Score 

Percentage 

°) 

Previouly  digitized  faces 

11/16 

69 

p) 

Added  faces  ver  1 

23/34 

68 

q) 

Combined  with  existing  faces 

34/50 

68 

r) 

Added  faces  simple  vote 

26  or  27/34 

76  or  79 

s) 

Combined  with  existing  faces 

37  or  38/50 

74  or  76 

t) 

Added  faces  averaged 

28/34 

82 

u) 

Combined  with  existing  faces 

39/50 

78 

45  faces 

Raw  Score 

Percentage 

(revision  of  above  scores) 

v) 

Previouly  digitized  faces 

11/14 

79 

w) 

Added  faces  ver  1 

22/31 

71 

x) 

Combined  with  existing  faces 

33/45 

73 

y) 

Added  faces  simple  vote 

25  or  26/31 

81  or  84 

Z) 

Combined  with  existing  faces 

36  or  37/45 

80  or  82 

aa) 

Added  faces  averaged 

27/31 

87 

bb) 

Combined  with  existing  faces 

38/45 

84 

Note:  Where  voting  schemes  result  in  a  tie,  two  scores  are 
given  separated  by  "or".  The  higher  score  is  for  the  tie 
counting  as  recognition  and  the  lower  score  is  for  the  tie 
counting  as  failure  to  recognize. 
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Face  Location  Problems.  It  was  later  discovered  that 
some  faces,  although  located  and  processed,  were  not  located 
correctly.  For  example,  sometimes  a  dark  area  under  the 
chin  was  used  as  the  mouth  instead  of  the  mouth  itself. 

This  would  occur  on  only  some  of  the  faces.  When  four  faces 
are  averaged  for  training,  some  using  correct  features  and 
some  not,  the  feature  set  is  distorted.  The  faces  found  to 
have  this  problem  are  denoted  in  the  tables  by  asterisks  in 
front  of  the  name. 

If  these  faces  arc  discarded,  because  they  were  not 
located  and  processed  as  intended  by  the  algorithm,  the 
recognition  performance  scores  must  be  revisited.  The 
resulting  scores  can  be  seen  in  Table  4,  lines  h,  i,  and  j. 
The  scores  for  the  previously  digitised  faces  remained  about 
the  same.  There  was  an  improvement  in  recognition  scores 
for  added  faces  (67%  or  69%,  depending  on  resolution  of  the 
tie)  and  for  all  faces  (71%) . 

Test  of  FACEFT.  FACEFT  used  a  classical  Fourier 
transform  instead  of  an  FFT.  The  results  of  testing  against 
FACEFT  are  shown  in  Table  5.  Once  again  the  table  is 
divided  into  two  portions,  previously  digitized  faces  and 
added  faces. 

T  e  results  for  all  50  faces  are  tabulated  in  Table  4, 
lines  o,  p,  and  q.  Recognition  scores  are  improved  over  the 
FFT,  at  68%  and  69%.  The  results,  after  discarding  the 
faces  not  located  and  processed  correctly,  are  shown  in 
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Table  5 


FACEFT 


Name 

Ver  1 

Ver  2 

Ver  3 

ver  4 

Averaged 

mkabrisky 

y 

y 

y 

y 

V 

■c 

mmaneely 

y 

y 

y 

8 

y 

rfiier 

y 

y 

y 

y 

y 

vmilholen 

y 

y 

y 

y 

y 

wrecla 

y 

y 

y 

y 

y 

pwhalen 

2 

y 

y 

y 

y 

jbrill 

y 

y 

y 

y 

y 

*  rjackson 

y 

y 

2 

y 

y 

mreinig 

2 

y 

y 

y 

y 

jhamilton 

y 

3 

y 

y 

y 

*  rricart 

5 

6 

4 

6 

5 

ssablan 

y 

y 

y 

y 

y 

dbossert 

y 

y 

y 

y 

y 

thamilton 

y 

y 

2 

2 

y 

chogan 

2 

2 

i 

y 

y 

rsmith 

7 

3 

10 

13 

8 

tmanaly 

y 

y 

y 

y 

y 

pmarshall 

y 

V 

y 

y 

y 

jlong 

>15 

>15 

>15 

>15 

>15 

mleahy 

3 

3 

3 

3 

3 

syarost 

5 

4 

2 

y 

2 

tdavis 

y 

y 

y 

y 

y 

mjohnson 

y 

y 

y 

4 

y 

*  dumphress 

5 

5 

5 

9 

7 

jsrubar 

2 

y 

2 

y 

y 

fbrown 

2 

y 

3 

y 

y 

brobb 

y 

>15 

y 

y 

y 

gmiracle 

y 

y 

y 

y 

y 

ssheldon 

y 

y 

y 

y 

y 

sberger 

y 

y 

y 

y 

y 

sfiler 

y 

y 

y 

y 

y 

bconway 

y 

y 

y 

y 

y 

dbarr 

y 

y 

y 

y 

y 

kfife 

y 

y 

y 

y 

y 

key:  -  y  means  yes,  face  recognized  correctly  (first  choice) 

-  number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 

-  >15  means  correct  person  not  in  list  of  top  15 
choices 
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Table  5. 


FACEFT  (continued) 


Name 

Ver  1  Ver  2  Ver  3 

rmaple 

>, 

mlambert 

6 

dlambert 

y 

srogers 

y 

ecrawford 

13 

*  mmayo 

3 

jsillart 

y 

dbane 

y  2  y 

*  druck 

11 

kcox 

y 

mdrylie 

y 

gtarr 

y  y 

mohair 

3  2 

dbridges 

y  y 

glorimor 

y 

rmorales 

y  y 

key:  -  y  means  yes,  face  recognized  correctly  (first  choice) 

-  number  means  face  not  recognized,  number  is  placement 
of  correct  person  in  list  of  choices 

-  >15  means  correct  person  not  in  list  of  top  15 
choices 
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Table  4,  lines  v,  w,  and  x.  These  are  the  best  scores  yet; 
the  best  score  being  79%  for  previously  digitized  faces, 
added  faces  and  combined  faces  scoring  71%  and  73%, 
respectively. 

Increasing  Data  Base Size 

The  results  of  this  change  are  not  evaluated  separately; 
the  value  is  in  showing  how  program  changes  perform  against 
a  larger  data  base  of  faces. 

There  were  unanticipated  problems  found  when  adding  new 
faces  to  the  data  base.  The  Signal  Processing  Lab  had  moved 
to  a  new  location  and  the  overhead  lighting  was  different. 
Many  seemingly  good  face  images  could  not  be  found  by  the 
face  locator.  The  overhead  lighting  was  strong  enough  to 
"wash  out"  the  upper  half  of  many  faces,  while  creating  dark 
shadows  on  the  lower  portions  of  the  face. 

This  situation  was  alleviated  somewhat  by  placing  a  desk 
light  upside  down  on  the  floor  near  the  camera.  The  problem 
was  also  correctable  on  some  faces  by  adjusting  the 
brightness  threshold  (an  option  on  the  main  menu  of  the 
AFRM) . 

Another  problem,  previously  noted  in  this  chapter,  is 
that  the  face  locator  would  occasionally  use  an  incorrect 
part  of  the  face  as  a  feature.  Most  common  was  a  dark 
shadow  between  the  mouth  and  chin  being  used  as  the  mouth. 
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auXMPiJS-Lo..QKs 


There  are  many  ways  to  implement  voting  and  then  many 
ways  to  score  performance.  Tables  3  and  5  (for  programs 
FACEDFT  and  FACEFT)  show  the  results  of  testing  with  four 
test  images  of  each  individual  for  new  faces  added  to  the 
data  base.  Two  voting  schemes  were  evaluated. 

First,  a  simple  vote  was  used,  counting  how  many  times  a 
person  was  correctly  identified.  In  cases  with  an  even 
number  of  faces,  ties  were  broken  by  examination  of  who 
ranked  above  an  individual  not  successfully  recognized. 
Occasionally,  there  was  still  a  tie,  such  as  the  tests  on 
mohair  and  jsrubar. 

The  results,  before  the  face  location  problem  was 
discovered,  are  given  in  Table  4,  lines  d  and  e  (79%  or  82% 
for  added  faces  only  and  72%  or  76%  for  all  faces)  for 
FACEDFT  and  lines  r  and  s  (76%  or  79%  for  added  faces  only 
and  74%  or  76%  all  faces)  for  FACEFT.  The  results  after 
discarding  the  problem  faces  are  shown  in  Table  4, lines  k 
and  1  (87%  or  90%  for  cictded  faces  and  78%  or  82%  for  45 
faces)  for  FACEDFT  and  lines  y  and  z  (81%  or  84%  for  added 
faces  and  80%  or  82%  for  45  faces)  for  FACEFT.  These  are 
improved  scores  over  not  using  a  voting  scheme. 

The  second  voting  scheme  is  given  in  the  "averaged" 
column,  referring  to  averaging  the  four  test  feature  sets  in 
the  same  way  training  feature  sets  are  done.  By  averaging 
the  four  corresponding  values  for  each  feature,  not  only  is 
the  closest  face  important,  but  how  far  off  any  missed  faces 
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are  is  a  factor  in  recognition.  This  was  only  tested  with 
new  faces,  as  only  those  faces  have  four  values  for 
averaging. 

Performance  on  all  added  f?ices  using  averaging  is  shown 
in  Table  4,  lines  f  and  g  (82%  for  added  faces  and  74  or  76% 
for  all  faces)  for  FACEDFT  and  lines  t  and  u  (82%  for  added 
faces  and  78%  for  all  faces)  for  FACEFT.  The  result,  after 
discarding  the  faces  not  located  and  processed  correctly,  is 
shown  in  Table  4,  lines  m  and  n  (87%  for  added  faces  and  78% 
or  80%  for  45  faces)  for  FACEDFT  and  lines  aa  and  bb  (87% 
for  added  faces  and  84%  for  45  faces)  for  FACEFT. 

Documentation 

The  results  of  documenting  the  system  are  difficult  to 
measure.  This  researcher  referred  often  to  notes  that  were 
the  basis  for  this  documentation.  But  the  more  important 
measure  is  how  useful  it  is  to  those  modifying  this  system 
in  the  future. 

Summary 

This  chapter  showed  the  results  of  the  research  efforts  of 
this  thesis.  The  next  chapter  discusses  conclusions  that 
may  be  reached  from  these  results. 
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V.  Conclusions  and  Recommendations 


Introduction 

This  chapter  presents  conclusions  that  can  be  reached  os 
a  result  of  this  thesis  research.  Recommendations  for 
further  development  of  the  AFRM  are  provided. 

Feature  Set 

Correcting  and  enhancing  the  use  of  the  FFT  to  form  the 
feature  set  improved  performance  of  the  system,  after  the 
incorrectly  located  faces  were  eliminated.  Sander's 
recognition  score  was  63%;  here  71%  recognition  was  achieved 
for  the  added  faces.  Performance  scores  for  previously 
digitized  faces  was  not  improved,  but  were  not  totally 
controlled  for  this  thesis  (previous  processing  of  image  not 
well  documented  or  understood) .  The  recognition  score  for 
all  45  faces  was  67%  or  69%,  depending  on  how  the  tie  is 
resolved. 

Substitution  of  the  classical  Fourier  transform  gave 
equal  or  better  overall  recognition  than  the  FFT.  The 
recognition  score  was  71%  fcr  added  faces.  Scores  for 
previously  digitized  faces  improved  significantly,  to  79%. 
The  recognition  score  for  all  45  faces  was  73%. 

When  the  windows  of  the  face  were  examined  individually, 
no  one  window  showed  performance  superior  to  the  combination 
of  all  windows.  This  can  be  seen  in  Table  2. 
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The  choice  of  window  contents  was  briefly  evaluated  and 
no  change  is  recommended. 

Addition  of  the  third  harmonic  to  the  feature  set  was 
reconsidered.  The  possible  increase  in  recognition 
performance  was  not  believed  to  be  worth  the  extra 
processing  time,  since  recognition  performance  was 
significantly  improved  by  other  means. 

Increasing- Data  Base  size 

Increasing  the  data  base  size  was  important  for  properly 
evaluating  other  objecti  >es  in  this  thesis.  Adding  more 
people  to  the  training  and  test  data  bases  gives  higher 
confidence  in  the  results. 

Multiple  Looks 

Adding  multiple  looks  at  a  face  for  recognition,  both  by 
simple  voting  and  mathematical  averaging,  increased 
performance  of  the  AFRM  for  both  of  the  Fourier  transforms. 
Since  the  averaging  technique  gave  equal  or  better 
performance  than  simple  voting,  the  averaging  technique  is 
preferred. 

The  best  recognition  score,  87%  (assuming  ties  cannot  be 
resolved  as  recognition) ,  was  achieved  by  the  combination  of 
either  modifying  the  FFT  or  using  the  classical  Fourier 
transform,  using  the  averaging  technique  for  voting,  and 
eliminating  faces  not  corrected  located. 

When  all  of  these  changes  are  combined,  the  FFT  and 
classical  Fourier  transform  seem  to  perform  equally  well  to 
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each  other.  Both  the  enhanced  FFT  and  the  classical  Fourier 
transform  gave  higher  recognition  scores  than  Sander 
achieved. 

Documentation 

The  system  documentation  is  now  extensive  and  complete  to 
support  future  research  efforts. 


Summn  rv 

This  thesis  demonstrates  that  the  coefficients  of  the 
Fourier  transform  are  a  good  feature  set  for  face 
recognition,  with  87%  recognition  scores  realized. 

Recommendations  for  Further  Research 

Many  recommendations  of  Lambert,  not  yet  investigated, 
remain  as  potentially  valuable  areas  to  explore.  These 
include: 

-  use  of  color  images 

-  use  of  binocular  images 

-  use  of  a  parallel  processor 

-  development  of  a  better  set  of  facial  features  for 

face  location 

Other  recommendations  of  Lambert  also  remain  valid.  Those 
listed  above  should  be  given  higher  priority  (Lambert, 

1987 ; 6-2  through  6-5). 

Many  of  Sander's  recommendations  were  explored  in  this 
thesis.  The  remaining  suggestions  that  were  not  explored 
but  still  quite  valid  are: 
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-  search  Cor  a  feature  set  that  is  scale  and  rotation 
independent,  such  as  use  of  the  log  z  transform 

-  evaluate  the  implemented  neural  network  and  .compare 
performance  to  other  existing  neural  networks 

-  move  the  chosen  neural  network  to  a  parallel 
processing  or  vector  processing  machine  (Sander, 

193a : j5-36) 

As  a  result  of  this  thesis  the  following  recommendations 
are  made: 

-  As  mentioned  above,  Lambert  suggested  improvements  to 
the  face  location  algorithm.  This  was  found  to  be  a 
significant  problem  when  adding  faces  to  the  AFRM. 
with  the  possible  selection  of  incorrect  features  that 
are  physically  close  to  the  correct  features,  manual 
observation  of  the  face  location  process  is  required. 

-  Perhaps  controlled  lighting  should  be  added  to  list  of 
assumptions  for  the  AFRM  (Chapter  1) ,  if  the  program 
cannot  be  made  to  overcome  the  lighting  problems. 

-  Further  experimentation  may  demonstrate  whether  the 
classical  Fourier  transform  or  the  FFT  is  superior  for 
faces.  Perhaps  still  another  transform  can  be  found 
to  improve  performance  further. 
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Appendix  A 

AFRM  -  Autonomous  Face  Recognition  Machine 
USER'S  MANUAL 


This  is  an  updated  version  of  the  User's 
Manual  written  by  Lambert  (Lambert, 

1987 : Appendix  C) .  Those  portions  not 
changed  were  copied  verbatim.  Some 
portions  were  rewritten  and  material  was 
added  and  deletea  to  reflect  the  current 
system. 
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Introduction 


The  information  presented  in  this  manual  is  divided  into 
2  parts:  Chapter  1  gives  enough  information  for  a  casual 
user  to  operate  the  AFRM  (Autonomous  Face  Recognition 
Machine) ,  and  Chapter  2  gives  information  needed  to  maintain 
the  AFRM. 

User-friendliness  was  a  primary  concern  when  developing 
the  AFRM.  The  AFRM  is  menu-driven,  giving  the  user  choices 
of  actions.  Prompts  tell  the  user  exactly  what  is  required 
from  each  keyboard  (user)  entry.  The  system  is  as  much  as 
possible  fault  tolerant.  The  AFRM  code  has  been  documented 
thoroughly  in  Appendix  C.  The  program  is  written  in  the  C 
programming  language  (Appendix  D) .  The  goal  was  to  write 
the  code  as  efficiently  as  necessary,  and  then  as  readable 
as  possible. 

It  is  hoped  that  future  modification  to  the  AFRM  will 
maintain  an  easy  user  interface  and  complete  system 
documentation. 
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I.  Operation 


Logging  On  and  Off 

The  easiest  way  to  get  to  know  the  AFRM  is  to  sit  down 
and  use  it.  It  is  located  on  the  Micro-VAX  II  designated 
IMAGER,  or  SMV2A,  in  the  AFIT  Signal  and  Information 
Processing  Lab.  To  run  the  AFRM,  log  onto  IMAGER  and 
execute  the  program.  For  example: 

run  [kabrisky.brobb.code] facedft 
The  system  will  run  automatically;  it  will  perform  several 
seconds  of  hardware  and  software  initialization,  remind  you 
to  turn  on  the  camera  and  video  monitor,  and  present  the 
main  menu.  When  you  are  done  using  the  AFRM,  return  to  this 
main  menu  and  select  the  QUIT  option.  This  will  get  you  out 
of  the  program,  reminding  you  to  turn  off  the  camera  and 
video  monitor. 
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Things  You  Should  Mot  Do 


1.  The  AFRM  needs  to  create  temporary  files  now  and  then 

as  a  normal  part  of  its  operation.  It  will  delete  these 

files  as  soon  as  they  are  no  longer  needed.  Since  these 

files  are  created  and  deleted  without  informing  the  user, 

the  user  should  avoid  saving  files  with  these  temporary  file 

names.  Never  save  faces  in  files  named: 

BNORM . IMG 
ORIG.IMG 

At  some  unannounced  time  YOU  WILL  LOSE  THEM. 

2.  The  AFRM  has  been  designed  to  be  fault  tolerant.  You 
can  enter  anything  you  want,  at  any  prompt  you  want,  and  the 
AFRM  should  handle  it.  The  AFRM  will  inform  you  if  your 
input  is  invalid.  The  only  entries  that  should  not  be 
entered  are  CTRL-C  and  CTRL-Y,  which  terminate  the  program 
without  going  to  the  main  menu  option  QUIT.  These  should 
not  be  used  because  the  AFRM  will  not  save  updated  database 
files. 
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Menus 


The  menus  allow  the  AFRM  user  to  do  the  following: 

0:  QUIT 

This  is  the  proper  way  to  exit  the  AFRM. 

Updated  database  files  are  saved  at  this  time. 

1:  ACQUIRE  IMAGES 

There  are  several  ways  to  input  images  into  the 
AFRM  and  there  is  a  sub-menu  for  all  of  the 
options. 

0:  RETURN  TO  MAIN  MENU 

1:  STATIONARY  TARGET 

Allows  acquisition  of  a  512  X  480  image 
from  the  camera. 

2:  MOVING  TARGET 

Acquires  a  background  scene  from  the 
camera  (nobody  in  it) ,  then  acquires  a 
second  scene  (with  subject) .  The  AFRM 
will  provide  the  rectangular  area  which 
bounds  the  region  that  changed  between  the 
two  scenes.  This  target  area  is  all  that 
is  processed  by  the  face  locator  (if 
locator  is  selected)  and  so  the  face 
locator  will  be  faster  than  it  would  be 
for  a  full  size  scene  as  well  as  being 
less  likely  to  acquire  a  false  target. 

3:  LOAD  IMAGE  FROM  MEMORY 

Allows  user  to  load  a  previously  stored 
image  (up  to  200  X  200)  to  the  video 
screen. 

4:  SAVE  IMAGE  IN  DATABASE 

Allows  user  to  save  a  full  screen  image 
(512  X  480) . 

5:  SET  CAMERA  PORT 

The  default  is  port  (0) .  This  allows 
connecting  additional  cameras  to  ports  (1) 
and  (2) . 

6:  CAMERA  CHECK 

Allows  continuous  acquisition  of  images  so 
the  camera  can  be  positioned  and  focused. 

7:  RE-INITIALIZE  HARDWARE 

Go  back  to  default  camera  port,  clear  the 
video  screen,  etc. 
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8:  LOAD  LARGE  IMAGE  FROM  MEMORY 

Allows  user  to  load  a  previously  stored 
full-screen  image  (512  X  480)  . 

2:  FIND  FACES 

The  face  location  algorithm  will  look  for  faces 
in  the  image  on  the  screen  and  save  all  it 
finds  to  temporary  files.  There  is  an  option 
to  sharpen  the  scene  that  is  normally  not 
needed  but  sometimes  helps  the  face  finding 
process. 

3:  GESTALT  AND  IDENTIFY  /  SAVE 

This  option  only  works  after  a  face(s)  was 
found  by  option  #2.  If  no  face(s)  was  found 
then  this  option  will  return  to  the  main  menu. 
This  option  runs  the  gestalt  algorithm  of  the 
first  face  found  by  option  |2.  Then  it  runs 
the  recognition  algorithm  on  that  face.  During 
recognition  the  user  is  allowed  to  save  the 
face  and  its  gestalt  data  in  the  database. 

There  is  no  other  time  when  a  new  face  and  its 
gestalt  data  are  available  for  saving  in  the 
database,  so  save  it  NOW  if  desired,  otherwise 
it  will  have  be  gestalted  again  (faces  are 
easily  deleted  from  the  database  if  later  not 
needed) .  If  more  than  one  face  was  found  in 
option  %2,  then  all  faces  will  be  gestalted  and 
identified  in  the  order  found. 

4:  DISPLAY  CONTENTS  OF  DATABASE 

Shows  names  of  faces  for  which  the  AFRM  has 
been  trained  and  names  and  version  numbers  of 
faces  that  can  be  used  for  reccgnition. 

5:  DELETE  A  SUBJECT 

This  option  deletes  the  training  file  for  this 
subject.  The  actual  images  and  gestalt  values 
will  still  be  saved  as  faces  that  can  be  used 
for  recognition  and  the  AFRM  can  be  retrained 
with  this  subject  later. 

6:  DELETE  AN  IMAGE 

This  option  allows  the  deletion  of  single 
images  (files  that  are  used  for  recognition) . 
The  actual  images  are  saved  as  images  that  are 
neither  trained  or  used  for  recognition,  but 
can  later  be  reused  for  either  purpose. 

7:  TRAIN 

This  allows  the  user  to  train  the  database  with 
4  files  from  the  .IMG  section  (faces  used  for 
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recognition)  of  the  database.  The  files  must 
all  have  the  same  name  and  must  have  different 
version  numbers.  To  exit  this  option  at  any 
time,  enter  a  zero  version  number. 

Fault  tolerance  is  really  evident  in  this 
section  of  the  AFRM  because  it  is  so  important 
to  maintain  a  correct  database.  The  AFRM 
constantly  checks  user  inputs  for  validity  and 
gives  out  pertinent  information  when  it  finds  a 
mistake.  For  example,  suppose  it  is  decided  to 
train  the  AFRM  with  the  name  Smith,  version 
numbers  l,  2,  3,  and  4.  The  AFRM  will  verify 
that  the  name  entered  exists  in  the  . IMG 
section  and  that  it  does  not  exist  in  the 
trained  section.  It  will  verify  that  files 
exist  for  all  the  versions  selected  and  that 
the  same  version  number  was  not  selected  more 
than  once.  If  a  mistake  is  made,  the  user  may 
exit  at  any  time. 

8:  DEMONSTRATION 

0:  RETURN  TO  MAIN  MENU 
1:  IDENTIFY  A  PERSON 

This  option  allows  the  user  to  demonstrate 
the  recognition  capabilities  with 
previously  gestalted  and  saved  images, 
trained  and  not  (those  used  for 
recognition) .  This  option  can  also  be 
used  to  obtain  recognition  scores  so  that 
the  AFRM  can  be  evaluated. 

2:  TOTAL  SYSTEM 

This  option  allows  the  user  to  run  all 
AFRM  algorithms  together  starting  at  image 
acquisition  (moving  target)  and  ending 
with  recognition.  It  is  advised  that  the 
user  first  select  the  camera  port  and  do  a 
"camera  check".  Then  this  option  is 
chosen.  When  the  screen  is  blank,  have 
the  subject  walk  into  the  field  of  view  of 
the  camera,  turn  and  stare  at  the  camera, 
and  stand  still  for  a  few  seconds.  As 
soon  as  the  AFRM  "sees"  the  subject,  it 
will  snap  a  picture  and  begin  to  look  for 
a  face.  If  a  face  is  found,  then  the  AFRM 
will  gestalt  it  and  try  to  recognize  the 
individual.  (There  is  no  option  to  save 
the  face.) 
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9:  CHANGE  THRESHOLD 

This  option  is  used  to  change  the  brightness 
threshold  used  by  the  face  location  algorithm 
(option  §2).  The  default  value  is  zero.  To 
get  a  darker  image  (more  pixels)  ,  increase  the 
value,  using  a  small  (1  through  5  recommended) 
positive  integer.  To  get  a  lighter  image  (less 
pixels) ,  decrease  the  value,  using  a  small 
(-1  through  -5  recommended)  negative  integer. 
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II.  Technical  Details 


Files 


Many  files  support  the  AFRM,  both  for  development  and 
use.  The  files  are  backed-up  on  tape  in  the  Signal  and 


Information  Processing  Lab.  It  contains  the  following: 


[kabrisky .brobbj 
editini.edt 
login.com 


-  main  directory 

-  for  full-screen  edit  mode 

-  for  logging  onto  system 


[ kabrisky . brobb . code ] 
autotake. c 
autotake.exe 
autotake.obj 
facedft.c 
facedft.exe 
facedft.obj 
faceft.c 

options_file.opt 

rl.com 


-  cor^e  directory 

-  program  to  take  4  pictures  of  a 

person  and  consolidate  as  one 
large  image 

-  updated  version  of  Sander  system 

(see  Appendices  B,  C,  and  D) 

-  substitute  transform  for  facedft 

(see  Appendix  E) 

-  for  compile 

-  for  link 


( kabrisky . brobb . dbase ] 
others.dat 
train.dat 
bothersfft.dat 
btrainfft.dat 
robbothers.dat 

robbtrain.dat 

othersft.dat 

trainft.dat 


-  database  for  face  program 

-  Lambert  test  face  feature  sets 

-  Lambert  training  face  feature  sets 

-  Sander  test  face  feature  sets 

-  Sander  training  face  feature  sets 

-  Robb  test  face  feature  sets  (from 
latest  facedft) 

-  Robb  training  face  feature  sets 
(from  latest  facedft) 

-  Robb  test  face  feature  sets 
( faceft) 

-  Robb  training  face  feature  sets 
(faceft) 


several  files  of  the  form: 

name.img;*  -  image  files  -  multiple  versions  of 

test  faces 

name. pic;*  -  image  files  -  multiple  versions  of 

training  faces 

nameset.img;*  -  image  files  -  sets  of  4  test  faces 

nameset.pic;*  -  image  files  -  sets  of  4  training 

faces 
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File  Linkages 


There  is  an  important  linkage  between  the  name.img;* 
files  and  othersft.dat  (or  any  others  file),  with  a  similar 
important  linkage  between  the  name. pic;*  files  and 
trainft.dat  (or  any  training  file).  When  images  are 
gestalted  and  saved  (option  3),  the  user  specifies  a  name 
for  the  picture,  usually  the  person's  first  initial  and  last 
name.  The  AFRM  adds  this  person  to  the  database  as 
name.img;*  where  *  is  the  next  consecutive  VMS  version.  The 
person  is  also  added  to  the  gestalt  file  (such  as 
othersft.dat),  the  version  number  being  the  next  consecutive 
gestalt  version  for  this  file,  THE  AFRM  ASSUMES  THAT  THESE 
VERSION  NUMBERS  MATCH!  This  will  be  true  if  the  user  always 
sticks  with  the  same  training  and  others  file  (can  be 
changed  in  the  program)  and  if  the  user  never  uses  VMS  to 
alter  version  numbers.  NEVER  DO  A  VMS  PURGE  COMMAND  ON  THE 
DATABASE!  Pixel  images  of  people  will  be  lost  (forever,  if 
not  backed  up)  and  the  assumed  linkage  between  the  image 
file  and  gestalt  entry  version  numbers  will  be  lost. 
Similarly,  when  the  AFRM  is  trained  for  a  person  (option 
#7),  the  four  entries  in  the  others  file  are  copied  to  the 
training  file  as  versions  1,  2,  3,  and  4.  (There  can  only 
be  one  set  of  trained  faces  for  a  given  name.)  The  four 
name.irug;*  files  are  copied  to  be  name. pic  files.  This  is  a 
simple  VMS  copy.  The  AFRM  assumes  that  the  version  numbers 
will  be  1,  2,  3,  and  4. 
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When  a  subject  or  image  is  deleted  from  the  AFRM,  entries 
are  moved  between  the  training  and  others  files,  and 
name.img;*,  name. pic;*,  and  name.pxl;*  (pxl  files  not 
gestalted)  files  may  be  moved  around  and  version  numbers 
changed. 

BOTTOM  LINE:  Never  do  a  VMS  purge  command  on  the 
database  library.  Do  not  move,  copy,  rename,  etc.  any  pixel 
files,  unless  doing  development  work  on  the  AFRM,  and  taking 
into  consideration  the  above  description.  In  that  case,  it 
is  recommended  that  the  developer  study  the  program  and 
documentation  (Appendices  c  and  D)  to  be  certain  the  AFRM 
will  still  work  correctly.  It  would  be  even  better  to 
design  around  these  problems  and  correct  them. 
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Modification 


If  a  change  is  needed  in  the  AFRM,  then  the  C  source  code 
must  be  edited,  recompiled,  and  linked  to  the  appropriate 
libraries.  The  following  commands  are  needed  to  accomplish 
this: 

edit  name.c  (where  name  is  face  or  facedft 

cc  name  /nooptimize  or  whatever  version  is  to  be 
Qrl  name  modified) 

The  nooptimize  option  on  the  compile  (second  command)  is 
necessary.  When  the  optimizer  is  used  (the  default  for  the 
command)  the  program  will  compile  and  link  but  not  run 
correctly.  The  error  is  usually  a  floating  point  error  in 
the  subroutine  called  recognize.  This  has  been  reported  to 
Systems  Engineering. 

The  third  command  runs  a  command  file  called  rl.com  which 
identifies  all  the  appropriate  libraries  for  you  (so  you 
don't  have  to  do  all  that  typing),  rl.com  and  an  associated 
file  called  options_f ile.opt  are  located  in  the  code 
directory.  The  contents  of  these  files  are  as  follows: 
rl . com 

$  link  ' PI 1 ,duaO: ( itilQO . itex] itexlOO/library , - 

duaO : ( itilOO . toolbox] toolbox/ library , - 

duaO: (itilOO.vms]vmslOO/library, - 

dua2 : (kabrisky.brobb.code]options_file/opt 

options  file. opt 
sys$share: vaxcrtl. exe/share 

When  changing  the  program,  make  sure  that  the  define 
statements  at  the  beginning  of  the  program  point  to  the 
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correct  database  libraries.  See  Appendices  c  and  D  for  the 
documentation  and  code. 

To  create  a  new  training  or  others  file,  simply  create 
that  file  with  a  zero  on  the  first  line  (means  zero  faces  in 
file)  and  an  asterisk  on  the  second  line.  Change  the  define 
statement  at  the  beginning  of  the  program  to  point  to  the 
file(s)  to  be  used. 

A  modification  that  may  be  necessary  in  the  future  is  a 
change  to  the  declared  size  of  the  arrays  in  the  AFRM.  The 
AFRM  is  presently  set  to  handle  up  to  100  subjects  in  the 
training  file  (400  gestalt  sets,  tlist[400])  and  200  images 
in  the  others  file  (200  gestalt  sets,  ilist[200]). 
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These  files  are  backed-up  on  TK50  tape  007  in  the  Signal 
and  Information  Processing  Lab.  The  save  set  is 
KABRISKY. BCK,  dated  29  Jan  29.  It  contains  the  following: 


[kabrisky.brobb] 
autotake. c 
autotake.exe 
autotake. obj 
backup.com 
con.com 
edtini.edt 
face.exe 

l.com 
login.com 
read. me 
rrobb. img 


-  main  directory 

-  program  to  take  4  pictures  of 
individual  and  save  as  one  image 

-  back  up  system 

-  for  full-screen  edit 

-  Lambert  system  modified  to  run  for 
Sander 

-  link  C  program 

-  standard  VMS  file 

-  test  image 


( kabr isky . brobb . code ] 

b.lis  -  listing  of  compile  of  bfacefft 

bat.com  -  run  program 

batl.com  -  run  program 

face.c  -  Lambert  system  modified  to  run  for 

face.exe  Sander 

face. obj 

facedft.c  -  Sander  system  with  DFT 

facefft.c 

facefft.exe 

facemap.c  -  subroutine  from  system 

facenet.c  -  Sander  system  with  Neural  Network 

facenet.exe 

facenet. jou 

facenet.obj 

facenetdft.c  -  Sander  system  with  DFT  and  Neural 

Network 

facenetfft.c 

facenetfft.exe 

fft.c  -  subroutine  from  system 

get.com  -  copy  files 

l.com  -  link  program 

loadface.c  -  program  to  load  face  file  to  screen 

mom.c  -  program  to  calculate  distances  between 

mom.exe  feature  sets  of  faces 

mom2 .  c 

mom2 . exe 

raom2 . out 

my face.c  -  piece  of  system 

myface.exe 
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newface.c 

newface.exe 

nl.com 

options__f  ile .  opt 
put . com 
readfftfile.c 
results. 
results.net 
sander. img 
save_fft.c 
sub . doc 

testl5020.net 

testface.c 

testface.exe 

testsubs.c 

trans.c 


piece  of  system 
link  program 

needed  to  compile  and  link  C  programs 
copy  files 

subroutine  from  system 


subroutine  from  system 

block  comment  set  up  to  document 

routines 

piece  of  system 


Lambert's  code  for  feature  set 


[  kabrisky . brobb . code . or igcode ] 
autotake. c 
autotake.exe 
bright. c 
bright.exe 
face. c 
face_sig.c 
face_sig.exe 
graph. c 
graph.exe 
mti.c 
mti.exe 
newface.c 
sixel.c 
sixel.exe 
sub_demo . c 
sub  demo.exe 


-  Lambert's  files  - 

documented  in  his  thesis 
(Lambert,  1987: 

Appendix  B) 


[ kabrisky. brobb. code. thesisdbase]  -  empty 
[ kabrisky . brobb . dbase] 

b.dat  -  training  files  and  others  (test  faoe) 

bothersfft.dat  files  (feature  set  values)  for  various 

btrainfft.dat  versions  of  code 

nothersfft.dat 

ntrainfft.dat 

others.dat 

othersfft.dat 

train.dat 

trainfft.dat 
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several  files  of  the  form: 

name.img;*  -  pixel  files  -  multiple  versions  of  tost 

images 

name. pic;*  -  pixel  files  -  multiple  versions  of 

training  images 


[ kabrisky . brobb . prnt image] 
baddisp.c 
baddisp.exe 
baddisp.obj 
bat.com 
bhalf .c 
bhalf.exe 
bhalf .obj 
bhalfface.c 
bhalfface.exe 
bhalf face. obj 
faceloc. img 
l.com 
phtest .c 
phtest.exe 
phtest. for 
phtest. obj 
prntbig.exe 
prntbig. for 
prntbig.lis 
prntbig. obj 
prnth. for 
prnthuge.exe 
prnthuge. for 
prnthuge.obj 
prntm.exe 
prntm. for 
prntm.obj 
recognize. out 
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Appendix  B 


Corrections  and  Cleanup: 


-  Hard-coded  files  names  were  located  throughout  the 
program.  These  were  all  moved  to  the  beginning  of  the 
program  in  DEFINE  statements.  Those  files  now  arc  tho 
library  of  picture  images  for  training,  the  library  of 
picture  images  for  testing,  the  library  for  picture  images 
not  trained  or  tested,  the  training  data  base,  and  the 
testing  (others)  data  base. 

-  The  program  documentation  stated  that  the  data  base  files 
were  read  into  memory  at  the  start  of  the  AFRM  and  written 
back  to  disk  upon  exit.  This  was  not  true.  Now  it  is. 

-  The  program  attempted  to  save  the  data  base  files  upon 
exit  only  if  those  files  changed.  The  criteria  used  was  not 
conclusive  (same  number  of  entries  at  start  and  end) .  Now 
the  data  bases  are  truly  only  saved  if  changed.  Flags 
(TRAIN_CHANGED  and  OTHERS_CHANGED)  keep  track  of  the  files 
status. 

Cleaned  up  menus: 

-  options  in  ascending  order 

-  line  spacing  is  consistent 

-  all  options  are  listed  (0.9  and  1.8  existed  but  were 
not  shown  on  the  menu) 

-  code  is  ordered  by  option 

-  FACEREC  has  coding  errors.  Some  code  was  partially 
repeated  and  the  subroutine  would  not  link  correctly.  The 
code  was  corrected. 

-  It  was  found  that  compilation  with  the  optimizer  (the 
default)  created  a  program  that  could  fail  with  a  floating 
point  overflow  error.  It  was  determined  that  pointers 
within  the  structure  were  not  correct.  Compilation  without 
the  optimizer  eliminates  the  problem.  This  has  been 
reported  to  Systems  Engineering. 

-  Some  character  arrays  were  too  short  to  contain  the 
necessary  data.  This  occurred  when  file  names  were  built  by 
concatenating  pieces  of  data.  In  the  C  programming 
language,  offsets  are  used  even  if  out  of  range.  This 
caused  unpredictable  results,  depending  what  was  accessed. 
Character  arrays  were  expanded,  including  padding  for 
possible  future  expansion. 

Unused  code  was  deleted.  This  included  CORTRAN16, 
RTRANSA,  RTRANSB,  NEWLINE,  ORIGI,  ORIGK,  and  LOADFACE. 
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-  The  recognition  list  (option  3)  showed  a  ranking  of  all 
faces  in  the  data  base.  As  the  data  base  grew,  this  caused 
the  top  rated  faces  (the  most  important  ones)  to  roll  out  of 
view.  The  recognition  list  now  displays  only  the  top  15 
faces. 

-  Where  user  input  is  limited  (such  as  10  characters  for  a 
name) ,  this  limit  is  enforced. 

-  Deleting  a  trained  face  originally  (Lambert)  caused  the 
data  to  be  moved  from  the  training  data  base  to  the  testing 
(o\  ’iers)  data  base  and  the  video  images  to  be  renamed.  This 
was  changed  by  Sander  to  truly  delete  everything  associated 
with  the  face.  This  was  restored  to  the  Lambert  algorithm. 
Also,  when  images  are  deleted  from  the  testing  (other)  data 
base,  they  are  now  moved  to  the  pixel  library. 

-  Comments  have  been  updated. 

-  The  title  displayed  on  the  video  screen  has  been  updated 
to  1989. 

-  Spacing  and  indenting  has  been  improved  for  readability. 

-  User  messages  have  been  updated  and  improved. 

-  When  a  face  was  displayed  (1.3)  the  name  field  was  not 
changed.  If  a  name  was  already  up  there  (from  another 
option),  it  would  remain,  possibly  causing  confusion.  This 
field  is  now  blanked  when  an  image  is  displayed. 

-  When  a  face  was  displayed  (1.3)  it  was  put  in  the  upper 
left  corner  of  the  screen.  It  is  now  displayed  centered 
about  an  inch  from  the  top  of  the  screen. 

"  The  training  option  (7)  asked  for  version  -1  to  exit  the 
option.  But  the  program  only  looks  at  the  first  character 
(not  two) .  This  option  has  been  changed  to  look  for  version 
0  to  exit. 

-  Some  options  did  not  allow  the  user  to  exit  if  entered 
accidentally.  This  has  been  corrected  where  possible. 

-  The  display  of  test  images  (others)  showed  a  list  of  .IMG 
files.  This  was  misleading  since  it  is  really  a  list  of 
entries  in  the  test  (others)  data  base,  which  may  or  may  not 
match  the  list  of  .IMG  files.  This  has  been  changed. 

-  Option  1.8  was  very  similar  to  option  1.3.  Option  1.8  is 
now  rewritten  to  load  full-screen  pixel  files  to  the  video 
screen. 
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Warnings: 


The  following  problems  were  not  corrected  and  should  be 
noted: 

-  Only  the  first  digit  of  a  version  number  is  used  by  the 
program.  Version  numbers  must  not  exceed  9. 

-  Never  purge  the  data  base  libraries.  All  of  those 
versions  are  needed  by  the  AFRM. 

-  Never  alter  the  contents  of  the  data  base  libraries 
without  a  thorough  understanding  of  effects  on  the  AFRM. 

The  program  assumes  that  it  is  doing  all  manipulations  to 
this  library.  User  alterations  can  affect  the  AFRM. 

-  The  program  assumes  that  the  appropriate  libraries  and 
files  exist,  as  listed  in  the  DEFINE  statements  at  the 
beginning  of  the  program. 

-  FFT  and  DFT  are  used  interchangeably  in  both  the  code  and 
comments. 

-  The  code  is  very  inconsistent  in  level  of  detail.  For 
instance,  for  the  main  menu,  some  detailed  code  is  included 
instream  and  some  is  broken  out  into  subroutines.  Also  some 
names  are  not  meaningful  (such  as  MENU1  and  MENU2) .  It  was 
decided  not  to  make  major  changes  in  this  area,  because 
those  studying  the  progression  of  the  program  over  the  past 
few  years  would  lose  the  continuity  of  the  program  structure 
and  names  used  in  the  program. 
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Enhancements: 


-  The  2DDFT  routine  used  a  128  X  128  array.  It  was 
discovered  that  nothing  larger  than  64  X  64  was  ever  used 
(the  remainder  padded  with  zeroes) .  The  2DDFT  was  changed 
to  use  up  to  a  64  X  64  array. 

-  To  build  the  input  array  to  the  2DDFT,  every  other  pixel 
in  both  the  horizontal  and  vertical  direction  was  used.  To 
better  fill  the  64  X  64  array,  sometimes  every  pixel  in  one 
or  both  direction  was  used. 

-  A  voting  scheme  was  implemented  in  subroutine  RECOGNIZE. 
It  is  marked  by  comments  so  the  programmer  can  choose  to  use 
voting  or  not. 

-  A  classical  Fourier  transform  can  be  substituted  for  the 
FFT  used  by  Sander.  It  is  in  a  separate  source  file  called 
FACEFT.C.  It  can  be  exchanged  for  comparable  code  in 
FACEDFT. 
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Appendix  C 

Software  Documentation 


69 


Table  of  Contents 


Page 

Files  Used  by  FACEDFT . 71 

DEFINE  References  .  73 

INCLUDE  References  .  73 

Important  Global  Variables  .  .....  73 

High-Level  Pseudo-Code  .  74 

MAIN . 74 

MENU1 . 75 

MENU2 . 77 

MENU3 . 78 

FACEMAP . 79 

FEATUREMAP . 79 

GESTALT . 80 

SAVE_FFT . 80 

CLEAR_CRAY . 80 

FFT2 . 80 

FFT . 80 

BRIGHT  NORM . 81 

CONT_ENHANCE  .  81 

SCALE . 81 

FACEREC . 82 

RECOGNIZE . 83 

ISOLATE . 85 

AFRM . 85 

DEL . 86 

PRTC . 86 

CLS . 86 

READFFTFILE . .  .  .  86 

WRITEFFTFILE  .  86 

DISPLAY . 86 

COPYFILE . 86 

FACEFT . 87 


70 


Files  Used  bv  FACEDFT: 


-  file  containing  feature  sets  for  trained  faces 
pointed  to  by  DEFINE  of  TRAIN 

format  is: 

integer  -  number  of  face  entries  in  file 

for  each  entry  (there  are  4  entries  for  each  trained 
person) : 

character  -  name  for  face  (first  initial  and  last 
name) 

integer  -  version  number 

double  -  6  X  5  X  5 

for  each  of  6  windows  there  is  a  5  X  5 
array  (gestalt)  of  features,  which  is 
the  2DDFT  (DC  and  2  harmonics) 

*  -  EOF  marker 

-  file  containing  feature  sets  for  test  (others)  faces 
pointed  to  by  DEFINE  of  OTHERS 

format  is: 

integer  -  number  of  face  entries  in  file 

for  each  entry  (there  is  1  entry  for  each  face  test 
image) : 

character  -  name  for  face  (first  initial  and  last 
name) 

integer  -  version  number 

double  -  6  X  5  X  5 

for  each  of  6  windows  there  is  a  5  X  5 
array  (gestalt)  of  features,  which  is 
the  2DDFT  (DC  and  2  harmonics) 

*  -  EOF  marker 

-  name. pic;*  in  DBASEDIR  —  trained  face  images  (pixels), 

where  name  is  the  first  initial  and  last  name  of  the 
person;  there  should  be  four  version  for  each  person 

-  name.img;*  in  IMAGEDIR  —  test  (others)  face  images 

(pixels) ,  where  name  is  the  first  initial  and  last 
name  of  the  person 

-  name.pxl;*  in  PIXELDIR  —  any  other  face  images  (pixels) 

not  matching  trained  or  test  faces 
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orig.img;*  — 
image 

bnorm.img;*  — 
normalized 


used  to  temporarily  save  an  original  face 

used  to  temporarily  save  a  brightness 
face  image 
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DEFINE  References: 


DBASEDIR  -  library  with  pixel  images  used  for 
IMAGEDIR  -  library  with  pixel  images  used  for 
(others) 

PIXELDIR  -  library  with  other  pixel  images 
TRAIN  -  file  of  features  for  trained  faces 
OTHERS  -  file  of  featured  for  test  (others) 


training 

testing 


faces 


INCLUDE  References: 

These  statements  are  needed  to  link  this  program  with 
standard  system  routines  {I/O,  etc.)#  system  math  routines, 
and  ITEX  (video  processing)  routines. 


Important  Global  Variables: 

TLIST  -  structure  list  for  up  to  400  trained  face 

entries;  with  4  entries  per  face,  this  is  100 
trained  faces 

-  during  execution  of  the  AFRM,  the  TRAIN  file 
resides  in  this  structure  list  to  speed 
execution  of  the  system 

I  -  number  of  trained  face  entries  in  TLIST 

I LIST  -  structure  list  for  up  to  100  test  face  image 

entries 

-  during  execution  of  the  AFRM,  the  OTHERS  file 
resides  in  this  structure  list  to  speed 
execution  of  the  system 

K  -  number  of  test  face  image  entries  in  ILIST 

THR  -  brightness  threshold 

SX,SY,  -  position  and  dimensions  for  face 

FX,  FY 

TRAINED_CHANGED  -  used  to  determine  whether  or  not  TLIST 

structure  should  be  written  back  to  the 
TRAIN  file  when  application  is  terminated 

OTHERS__CHANGED  -  used  to  determine  whether  or  not  ILIST 

structure  should  be  written  back  to  the 
OTHERS  file  when  application  is  terminated 
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High-Level  Pseudo-Code: 


MAIM 


-  initialize  system/hardware 

-  display  title  screen  on  video  screen 

-  call  READFFTFILE  twice  to  read  trained  faces 
and  test  (OTHERS)  faces  into  main  memory  (TLIST 
and  XIiIST) 

-  initialize-  TRAIN__CHAHGED  and  OTHERS^CHANGED 

flags  to  false  ~ 

-  display  and  execute  MENUl  to  show  and  perform 
main  menu 
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MENU1  -  display  wain  menu  and  execute  user’s  choice: 

0:  quit 

-  if  changed,  save  trained  faces  and  test 
faces  from  wain  memory  (TLIST  and  ILIST) 
back  into  TRAIN  and  OTHERS  files 

-  return  to  operating  systew 

1:  acquire  iwages 

-  call  MENU2  to  give  options 

2:  find  faces 

-  give  user  option  to  sharpen  faces 

-  call  SHARPEN  if  option  chosen 

-  call  FACEMAP 

3:  gestalt  and'  identify  /  save 

-  call  FACEREC 

4:  display  contents  of  database 

-  call  DISPLAY  with  trained  faces  (TLIST) 

-  call  DISPLAY  with  test  (others)  face 
iwages  (ILIST) 

-  call  DISPLAY  with  trained  faces  (TLIST)  to 
show  user  choices 

-  get  subject’s  nawe  from  user 

-  loop  through  trained  faces  (TLIST) 

-  if  subject's  name  found 

-  loop  through  test  (others)  face  images 
(ILIST)  to  find  subject's  name  and 
largest  version  number 

-  increment  that  largest  version  number 

-  loop  4  times  (4  versions) ,  copying 
TLIST  entries  to  ILIST  as  new  versions 

-  move  actual  images  from  DBASEDIR  to 
IMAGEDIR 

-  continue  to  loop  through  TLIST,  moving 
the  remaining  images  up  4  places  (to 
delete  subject) 

-  if  subject  not  found  in  TLIST 

-  print  error  message 

-  *et  TRAINED_CHANGED  and  OTHERS_CHANGED 
flags 


6:  delete  an  image 

-  call  DISPLAY  with  test  face  images  (ILIST) 
to  show  user  choices 

-  get  subject's  name  and  version  number  from 
user 
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-  loop  through  test  face  images  (ILIST) 

-  if  subject's  name  and  version  number 
match  test  face  image 

-  move  actual  images  from  IMAGEDIR  to 
PIXELDIR 

-  continue  to  loop  through  ILIST,  moving 
each  entry  up  one  place  (to  delete 
subject) 

-  if  subject  not  found  in  ILIST 

-  print  error  message 

-  set  OTHERS_CHANGED  flag 

7:  train 

-  call  DISPLAY  with  trained  faces  (TLIST)  to 
show  user  names  of  trained  people 

-  call  DISPLAY  with  test  face  images  (ILIST) 
to  give  user  choices 

-  get  subject's  name  from  user 

-  loop  through  TLIST,  looking  for  subject 
name 

-  if  no  match,  print  error  message  and  exit 
option 

-  ask  user  for  4  version  numbers 

-  loop  4  times  (4  versions) ,  verifying 
unique  version  numbers  and  searching  ILIST 
to  verify  existence  of  image  files 

-  print  error  messages  as  appropriate 

-  loop  4  times  (4  versions) ,  copying  entries 
from  ILIST  tc  TLIST,  and  getting  rid  of 
ILIST  entries  by  moving  remaining  entries 
up 

-  move  actual  images  from  IMAGEDIR  to 
DBASEDIR 

-  set  TRAINED_CHANGED  and  OTHERS_CHANGED 
flags 

8:  demonstration 

-  call  MENU3 

9:  change  threshold 

-  allow  user  to  enter  new  variable  threshold 
(used  by  BRIGHT__NORM) 
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MENU2 


display  menu  and  execute  user's  choice: 

0;  return  to  main  menu 

1:  stationary  target 

-  use  ITEX  routines  to  put  camera  image  on 
video  screen 

2:  moving  target 

-  use  ITEX  routines  to  put  camera  image  on 
video  screen 

-  subtract  successive  images  and  look  for 
movement  (change) 

-  use  ISOLATE  to  isolate  target  from 
surroundings 

3:  load  image  from  memory 

-  loads  an  image  file  (pixels)  of  up  to 
200  X  200 

to  the  screen,  centered  and  near  the  top 

4 :  save  image 

-  saves  an  entire  video  screen  image  to  an 
image  (pixel)  file  in  PIXELDIR 

5:  set  camera  port 

-  allow  user  to  choose  camera  port  0,  1, 
or  2 

6 :  camera  check 

-  allow  user  to  adjust  camera  (focus  and 
such) 

7:  re-initialize  hardware 

-  initialize  hardware  and  clear  video  screen 

8:  load  face  from  memory 

-  similar  to  option  3  except  loads  a  full¬ 
screen  image 
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MENU3  -  display  menu  and  execute  user's  choice: 

0:  return  to  main  menu 

1:  identify  a  person 

-  call  DISPLAY  with  test  face  images  (ILIST) 
to  give  user  choices 

-  prompt  user  for  person's  name  and  version 
number 

-  search  ILIST  for  face  entry 

-  display  corresponding  picture  on  video 
screen 

-  call  RECOGNIZE 

2 :  total  system 

-  call  AFRM 
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FACEMAP 


FEATUREMAP 


use  BRIGHT_NORM  to  brightness-normal ize  the 
image;  then  use  FEATUREMAP  to  look  for  possible 
facial  features  (eyes,  nose,  mouth) ,  then  draw 
ellipse  and  rectangle  around  features  to  define 
face,  saving  bnorm.img  and  orig.img 


look  for  possible  features 
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GESTALT  -  display  windows  on  video  terminal 
-  set  up  6  windows  for  face 

-  calculate  gestalt,  or  feature  set,  for  each 
window 

-  use  CLEAR_CRAY  to  initialize  calculation 
arrays  to  zero 

~  put  values  for  windows  in  calculation  arrays 

-  call  FFT2  (2DDFT  routine) 

-  call  SAVE_FFT  to  save  Fourier  values  (DC  and 
first  two  harmonics)  in  ILIST[0]  (work  space) 


SAVE_FFT  -  save  2DDFT  information  in  ILIST(O)  (working 
space) 

-  the  feature  set  for  each  window  for  each  face 
is  a  5  X  5  array  (DC  value  and  first  two 
harmonics) 

-  this  data  must  be  copied  from  the  calculation 
arrays  to  ILIST(O): 


0 

1 

2 

3 

4 

0 

crayi 
( 02 ] [ 02 ) 

crayi 

(01](02) 

crayi 

(00](02) 

crayi 

[63][02] 

crayi 

(62](02] 

1 

crayi 

(02](01) 

crayi 

(01](01) 

crayi 

(00)[01) 

crayi 
[63] [01] 

crayi 

[62)[0l] 

2 

crayi 

(02)(00) 

crayi 

(0l](00] 

crayr 
[00] [00] 

crayr 
[00) (01) 

crayr 
[00] (02) 

3 

crayr 

(01)(62] 

crayr 

(01][63) 

crayr 

[01](00] 

crayr 
[01] [01] 

crayr 

[01](02] 

4 

crayr 
(02 J (62) 

crayr 

[023(63] 

crayr 

[02)(00] 

crayr 
[02] [01] 

crayr 
(02)  (0.2) 

CLEAR_CRAY  -  clears  (sets  co  zero)  the  calculation  arrays  to 
be  us  for  the  2DDFT 


FFT2  -  perform  2DDFT  (two-dimensional  discrete  Fourier 

transform)  with  FFT  (fast  Fourier  transform) : 

-  call  FFT  for  each  row 

-  call  FFT  for  each  column 


FFT  -  perform  one-dimensional  fast  Fourier  transform 
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BRIGHT_NORM  -  brightness-normalize  image 

(Lambert,  1987:3-15  to  3-21) 

-  use  threshold  set  with  main  menu,  option  9 


COHT_ENHANCE  -  contrast-enhance  image 

(Lambert,  1987:3-21,  3-22) 


SCALE  -  rescale  image  if  needed 
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display  brightness  normalized  face  (bnorm.ing) 
call  CONTJENHANCE  (commented  out  in  this 
version) 

call  SCALE  (commented  out  in  this  version) 
call  GESTALT  to  calculate  feature  set 
display  original  face  (orig.img) 

If  called  from  main  menu  option  3 

-  ask  user  whether  or  not  to  save  face  in  data 
base 

-  for  save, 

-  ask  for  subject  name 

-  find  highest  version  number  for  this  name 
and  increment 

-  add  face  information  to  ILIST 

-  save  face  in  name.img  file  in  IMAGEDIR 

-  set  OTHERS  CHANGED  flag 

-  call  RECOGNIZE  (using  ILISTfO))  to  try  to 
recognize  face 

delete  bnorm.img  and  orig.img 


RECOGNIZE 


-  attempts  to  recognize  the  current  image 

(parameter  passed  which  is  pointer  in  ILIST) 

-  loop  through  all  6  windows 

-  loop  through  all  trained  people  (sets  of  4 
faces) 

gix  =  the  average  of  this  feature  for  the 
4  training  entries 

gux  =  the  corresponding  test  feature  (can 
also  be  averaged  if  voting  scheme 
used) 

sum  the  squares  of  the  difference  between 
each  feature  and  gix  and  divide  that  sum 
by  4 

sigix  =  the  square  root  of  the  value  just 
calculated 

if  sigix  <  0.5,  set  it  to  0.5 
c  is  the  running  sum  of 

(gix  -  gux)2  /  4  *  sigix2 

-  v  «  e*c/,000°  *  the  window  weight 
(default  1.0) 

Note:  The  value  of  the  variable  c  now  gives 
a  measure  of  closeness  for  the  test  feature 
set  to  trained  feature  sets.  This  last 
equation,  giving  v,  reverses  the  values  so 
that  a  higher  score  means  a  closer  value 
and  a  lower  score  means  a  further  value. 
This  equation  also  scales  values  between 
zero  and  one. 

-  loop  through  all  people 

-  the  recognition  distance  for  each  person 
against  the  test  image  is  the  sum  of  the  v 
values  for  the  six  windows.  This  value  is 
between  zero  and  one,  with  the  highest 
value  as  the  closest  to  the  test  image 

-  sort  the  recognition  distances 

-  show  the  three  closest  faces  and  print  the 
names  and  distance  values  for  the  closest  15 
faces 
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if  there  aren't  three  faces  close  enough 
(settable  value),  print  message 


Note:  windows  can  be  weighted  by  setting 
values  (default  is  all  equal) 
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ISOLATE 


AFRM 


-  looks  for  moving  target  (changed  pixels)  on  top 
half  of  screen 


-  for  demo,  run  through  entire  AFRM  process, 
using  MTI  (moving  target  indicator)  and  not 
saving  any  images  or  feature  sets 
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DEL 


-  delete  current  image  -  BNORM . IMG  and  ORIG.IMG 


PRTC 

CLS 

READFFTFILE 


WRITEFFTFILE 

DISPLAY 


COPYFILE 


prompt  user  to  press  return  to  continue 


clear  the  terminal  screen 


read  a  feature  set  file  (first  parameter)  and 

load  into  structure  (second  parameter) 

-  first  read  an  integer  that  gives  number  of 
entries  in  file 

-  then  loop  to  read  entries  and  put  in 
structure 

-  for  each  entry  there  is  a  name  followed  by 
6  (windows)  X  5  X  5  (features)  floating 
values 

-  Note*  position  zero  in  the  structure  is  a 
work  area  and  is  not  used  by  this  procedure 


~  save  feature  set  file  (first  parameter), 
saving  from  structure  (second  peirameter) 

-  reverses  read  process  (described  above) 


first  parameter  gives  structure  (TLIST  or 
ILIST) 

second  parameter  gives  number  of  entries  in 
structure  third  parameter  is  a  flag  for  TLIST 
or  ILIST 

if  TLIST,  display  names  of  people  found  in 
TLIST 

if  ILIST,  display  names  and  version  numbers  for 
people  found  in  ILIST 


build  and  execute  command  to  copy  one  file 
{ first  parameter)  to  another  file  (second 
parameter) 
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EftCSEI 


FACEFT.C  is  a  separate  source  file.  It  contains  alternate 
versions  of  GESTALT,  SAVEJPFT,  CLEAR__CRA¥ ,  and  FT2.  These 
routines  can  be  swapped  for  the  comparable  code  in  FACEDFT, C 
to  use  a  classical  Fourier  transform  in  place  of  the  FFT. 
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Appendix  D 

FACEPFT  Sourefi  Listing 


88 


,  &*******************************************************###***#attA,itf4-iWi> 
* 

* 

*  This  is  FACEDFT.C 

* 

* 

***********  ************************************************************* 

*  Name  FACE  -  AUTONOMOUS  FACE  RECOGNITION  MACHINE 

* 

*  Author:  Laurence  C.  Lamberc  -  1987 

*  Based  on  che  Daca  General  (Eclipse/Nova)  AFRM  by  E.  Smich 

* 

*  12  JAN  88  L.  Lamberc 

a*********************************************************************** 

* 

*  Modified  in  1988  by  D.  Sander 

* 

*  Major  change  was  Co  use  2DDFT  for  feature  vectors  instead 

*  of  moment  calculation 

* 

************************************************************************* 

* 

*  Modified  in  1989  by  B.  Robb 

* 

*  Major  changes  were  to  add  choice  of  a  simple  (not  fast)  Fourier 

*  Transform  for  feature  set  (see  FACEFT.C),  averaging  of  four  test 

*  images  for  recognition,  and  several  clean-up  changes 

* 

*********************************************************************  */ 
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“define  dbasedir  "(kabrisky.brobb.dbase)" 

“define  imagedir  "(kabrisky.brobb.dbase)" 

“define  pixeldir  "(kabrisky.brobb.dbase)" 

“define  train  H[kabrisky.brobb.dbase)robbcratn.dac" 

“define  others  " (kabrisky.brobb.dbase) robbothers.dat" 

^include  "sys$library:stdio,h" 

“include  "duaO: (itilOO. itexjstdtyp.h" 

“include  "duaO: ( itilOO. itex) itexlOO.h" 

“include  <maeh> 

static  int  option, tost.sy.sx, fy, fx,nf ,x,y,t, thr-0; 

int  i,k;  /*  l  -  site  of  tiist,  k  -  size  of  iiist  */ 

char  era in_changed , o ehers_changed ; 

struct  list  ( 

char  name (11) ; 
int  num; 

double  feature) 6) (5) (5) ; 

); 

static  struct  list  tlist(400]  -  (0,0); 
static  struct  list  ilist(200)  -  (0,0); 
static  double  gauss(257); 
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/*********£*********************************************************#*»/ 
raaln()  /*  23  */ 

{ 


unsigned  base  -  0x1600; 

long  mem  -  Ox200000L; 

Inc  flag  "  1, block  -  8; 


sechdv(basc, mem, flag, block) ; 

Initialized ; 
sclear(100, l) ; 
cls(); 

princf("\n  Initializing  hardware  and  reading  dbase  files."); 

prlncf("\n  Please  turn  on  the  video  monitor  and  the  camera."); 

ccxe(120I200,0,8,0,"AFRM") ; 

06X0(110,415,0,1,0,"  AIR  FORCE  INSTITUTE  OF  TECHNOLOGY"); 
text( 110, 430, 0,1,0,"  SIGNAL  PROCESSING  LABORATORY"); 

texc( 110, 445,0, 1,0, "AUTONOMOUS  FACE  RECOGNITION  MACHINE"); 
cexcdlO, 460, 0,1,0,"  1989"); 

/*  del();*/ 

l  -  readffcflle(traln, cllst) ; 
k  -  readffcft.le(ochers, lllst) ; 
craln_changed  -  ' f 1 ; 
ochers^changp'  •*  '  f  * ; 

*■'  -  sx  -  „y  -  0; 

•  fy  -  511; 
il<); 
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/&a**a****************"A£****'*A**£***£*a*$***iSr£a******A*a**##****a*#**'-s*/ 
mcnul()  /*  55  */ 
( 


char  c2 ( 80 J , c3 ( 80 ] , cemp [ 80 J , ch { 80 J ;  /*  j,L  and  ra  are  counters  */ 
inc  ver(5) , j ,l,m;  /*  ver(l-A)  -  file  version  numbers  to  train  on.  */ 
int  r,v,vi.v2; 

Int  rot[5]  -  (-20,-10,0,10,20); 
for(;;)  ( 


cls(); 

prlntf("\n 

AUTONOMOUS  FACE  RECOGNITION  MACHINE\n  " 

printf ("\n 

*****  MAIN  MENU  *****\n  "); 

printf("\n 

0:QUIT") ; 

printf("\n 

1: ACQUIRE  IMAGES"); 

printf ("\n 

2: FIND  FACES"); 

printf(”\n 

3: GESTALT  AND  IDENTIFY  /  SAVE"); 

printf("\n 

4: DISPLAY  CONTENTS  OF  DATABASE"); 

prlntf("\n 

5: DELETE  A  SUBJECT"); 

printf("\n 

6: DELETE  AN  IMAGE"); 

printf ("\n 

7:TRAIN") ; 

printf("\n 

8: DEMONSTRATION"); 

printf("\n 

9 : CHANGE  THRES HOLD\n\n\n\n\n\n< " ) ; 

scanf("%d" ,&option) ; 

cls(); 

switch(option)  { 

case  0: 

printf(M\n\n  saving  DBASE  files..."); 
if  (train_changed  !-  'f') 

writefftfile(train, tlist, i) ; 
if  (others_changed  J-  'f') 

writefftfile(others , ilist,k) ; 
cls(): 

printf("  Please  turn  off  the  video  monitor  and  the  camera."); 

printf ( "\n\n\n\n\n\n\n\n\n\n\n\n" ) ; 

return; 

case  1: 
menu2() ; 
break; 

case  2: 

printf ("\n  Sharpen  image?  (Y/N/Quit)  >"); 
scanf("%s" ,ch) ; 

if  (ch ( 0 ]  —  'q'  ||  ch[0]  —  'Q')  break; 
if  (ch ( 0 ]  —  'y'  ||  ch(0]  —  'Y')  { 
sharpen(sx,sy,fx-sx,fy-sy,3) ; 

) 
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facemapQ ; 
break; 


case  3: 

facerec(l) ; 
break; 

case  4; 

display(tlist, 1,8) ; 
displny(ilist,k,6) ; 
ptcc(); 
break; 

case  5: 

display  (disc,  1,8); 

princ£("\n\n  *****  DELETE  SUBJECT  *****"); 

printf(”\n\n  Are  you  sure  (Y/N)?  >"); 
scan£("%s" , cemp) ; 

if  (temp(O)  I-  'Y'  &&  cemp[0)  !-  'y' )  break; 
printf("\n\n  Enter  subject's  name.  >"); 
scanf ("%s" , temp) ; 
printf ("\n") ; 

test  «  0; 

for  (j-1;  j<(i+l) ;  j-j+4)  ( 

if  ((strncrap(tlist[j J .name, temp, 11))  —  0)  { 

1-0;  /*  look  for  highest  existing  version  of  .IMG  file.  */ 

for  (m-1;  m<(k+l);  m++) 

if  (strncmp(ilist(m)  .name,  temp, 11)— 0  &&  ilist(m)  .num»l) 
l-ilist[raj .nura; 

1-1+1;  /*  add  1  to  highest  version  to  get  new  version.  */ 

for  (m-1;  m<5;  m++)  (  /*  put  4  new  versions  into  ilist.  */ 

k  -  k  +  1; 

ilist(k) .narae[0]  -  '\0' ; 
strncat(ilist{kj .name, temp, 11) ; 
ilist(k] .num  -  1; 
for  (w-0;  w<6;  w++) 
for  (wl-0;wl<5;wl++) 
for  (w2-0;w2<5;w2++) 

ilistfk) . feature[w) [wl] [w2]  - 
t-iist(j+(m-l) ) .  featurejw]  [wl]  [w2] ; 

i++; 

) 

1-1-4; 

for  (m-0;  m<4;  m++)  { 
t2 ( 0  J  -  *\0' ; 
t3(0)  -  '\0' ; 
strcat(t2,dbasedir) ; 
strcat(t3, imagedir) ; 
strcat(t2, temp) ; 
strcat(t3, temp) ; 
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sercac(c2,".pic;\0") ; 
strcac(t3, " . lmg;\0") ; 
ch[l)  -  '\0‘ ; 
ch(OJ  -  ra  +  1  +  'O' ; 
strcat(t2,ch) ; 
ch ( 0 J  -  1  +  '0' ; 
scrcat(c3,ch) ; 
copyflle(c2, c3) ; 
delece(c3) ; 

I 

for  (m«j;  m<(i-3);  m++)  cllsc(ra)  -  cllst[m+4); 
prlncf("\n") ; 
l  *•  l  -  4; 

j  "  1  +  2;  /*  forces  end  of  loop  through  disc  */ 

cesc  -  1;  /*  Indicates  that  subject  was  found  */ 

)) 

If  (cesc  !-  1)  prlncf("\n\n  Subject  not  found."); 
else  ( 

prlncf("\n\n  Subject  deleted  "); 
prlntf(" (Moved  from  training  data  base"); 
prlncf("  to  Image  data  base)"); 
craln_changed  -  't'; 
others  changed  -  ' c ' ; 

) 

prcc(); 

break; 

case  6; 

dlsplay(lllst,k,6) ; 

prlntf("\n\n  *****  DELETE  IMAGE  *****"); 

prlntf("\n\n  Are  you  sure  (Y/N)?  >"); 
scanf("%s" , temp) ; 

If  (cemp(0)  !-  'Y'  &&  temp(0)  !-  'y')  break; 
prlntf("\n\n  Enter  subject's  name.  >"); 
scanf ("%s" , temp) ; 

prlntf("\n\n  Enter  version  number.  >"); 
scanf("%s" ,ch) ; 
prlncf("\nH) ; 

test  -  0; 

for  (j-1;  j<(k+l);  j++)  { 

If  (strncmp(lllst(j ] .name, temp, 11)  —  0)  ( 

If  (lllst(j).num  —  (ch ( 0 J  -  '0'))  { 
t2 ( 0 J  -  '\0'; 
c3 (0 ]  -  '\0* ; 
strcat(t2 , Imagedlr) ; 
strcat(t3,plxeldlr) ; 
strcat(c2,temp) ; 
strcac(t3 , temp) ; 
strcat(t2, " . lmg;\0") ; 
strcat(t2,ch) ; 
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strcac(c3,".pxl\0"); 
copyfile(c2, c3) ; 
deiece(t2) ; 

for  (m-j ;  m<k;  m++)  ilisc(m)  -  ilisc[m+l); 
k  -  k  -  1; 
j  -  k  +  2; 
tesc  -  1; 

))) 

if  (cesc  !-  1)  princf("\n\n  Image  file  not  found."); 
else  ( 

prtncf("\n\n  Image  file  deleted  "); 
princf("(Movcd  from  image  data  base"); 
princf("  to  pixel  daea  base)"); 
others  changed  -  'e'; 

I 

prcc(); 

break; 
case  7: 

dtsplay(clisc, 1,8);  /*  194  */ 

dlsplay(ilist,k,6) ; 

printf ("\n\n  *****  TRAIN  *****"); 

prlntf("\n\n  Enter  person's  name.  >"); 
scanf("%s",cemp) ; 

test  -  0; 

for  (1-1;  l<(i+l);  1-1+4)  /*  cesc  name  */ 

if  ((scrncmp(clisc(l] .name, cemp.ll))  —  0)  cesc  -  1; 
if  (cesc  —  1)  ( 

princf("\n  Thac  name  already  exiscs  in  che  training  file."); 

prcc() ; 

break; 


for  (1-1;  l<(k+l);  1 -H-) 

if  ((scrncmp(iiist{lj .name, cemp.il))  —  0)  test  -  2; 
if  (cesc  !-  2)  ( 

printf("\n  There  are  no  image  files  with  chat  name."); 

prtcQ; 

break; 


printf("\n\n  You  must  enter  4  valid  (and  unique)"); 
printf ("  file  version  numbers."); 

printf("\n  (Enter  0  (zero)  to  quit  training  procedure)"); 
for  (j-1;  j <5 ;  j++)  ( 

princf("\n  Enter  version  number  for  training  file  #  "); 

princf("%d%s" , j , ">") ; 

scanf ("%s" ,ch) ; 

ver[ j ]  -  ch[0J  -  '0' ; 
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If  (vcr(j)  >  0)  ( 
cesc  -  0; 

for  <1-1;  1<J;  1++)  { 

If  (ver(i)  —  ver{  j  J )  ( 
display(lHse,k,6) ; 
princf("\n\n  You  already  selected:”); 
for  (m-l;  m<j;  m++)  princ£(”*sld" , "  ",vcr(m)); 

J  -  J  -  i; 

cesc  -  1; 

H 

If  (cesc  !-  1)  { 

for  <1-1;  l<(k+l) ;  1++)  ( 

if  (scrncrap(llisc(l} .name,cemp,ll)  —  0 
&&  ilisc(l).num  —  ver[j})  { 
cesc  -  1; 
l  «  k  +  2; 

)) 

if  (cesc  —  0)  { 

display(llisc,k,6) ; 

princf("ls%dM , "\n\n  File  version  *M,ver(j)); 
princ£(M  noc  found,  cry  another.”); 
if  (j  !-  1)  { 

princf("  (You  already  selected: H); 

for  (1—1 ;  l<j;  1++)  princ£(”%s%d" ”,ver(i)); 

princf(")") ; 

) 

j  -  J  -  i; 

)>) 

else  j  -  5; 


if  (j  —  6)  break; 

for  (j-l;  j<5;  j++)  { 
i  -  i  +  1; 

for  (1-1;  K(k+1);  1++)  { 

if  (scrncrap(ilisc[l) .name, cemp.ll)  —  0 
&&  ilise(l].num  —  ver(jj)  ( 
clist[ i]  -  ilisc(l); 

/*  find  proper  gescalc  file  in  ilisc,  */ 
tlist[i).nua  -  j;  /*  put  in  disc,  */ 

,  for  (m-1;  o<k;  m++)  ilisc(n)  -  ilisc[m+l); 

k  -  k  -  1;  /*  delece  from  ilisc,  */ 

)) 

c2(0]  -  '\0' ; 
c3(0]  -  *\0'; 
scrcac(c2.dbasadir) ; 
scrcac(c3 , imagedir) ; 
scrcac(c2, temp) ; 
scrcac(c3 , cerap) ; 
s treat (c2, " .pic;\0") ; 
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s treat (t3,".img;\0"); 
ch [ 1 )  -  *\0'; 
ch(0)  -  ver(j )  +  '0' ; 
strcat(t3,ch) ; 
ch(0]  -  j  +  'O’ ; 
strcac(t2pch) ; 
copyflle(t3, t2) ; 
delete(t3) ; 

) 

print£("ts%s%sH , M\n\n  The  training  flic  now  contains  <" , temp, ">") ; 
printf(" (Moved  from  image  data  base)"); 
trnin_changed  «  '  t'; 
others_changed  -  *t'; 

prtc(); 

break; 

case  8: 
monu3() ; 
break; 

case  9: 

printf(MEnter  the  new  variable  threshold  >"); 

scan£(M*d" ,&thr) ; 

break; 

default: 

break; 

n 

1 
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/*****************************************************44****x’***&*ft****/ 

menu2()  /*  287  */ 

( 


inc  cam; 

char  nnmc(80] , cl{ SO] , c2(80J , temp(80) ; 
cor  (;;)  { 


cls<); 
prlntf("\n 
prlnt£("\n 
prlnt£("\n 
prlntf("\n 
prlntf("\n 
prlntf("\n 
prlnt£("\n 
prlnt£("\n 
prlnt£("\n 
prlntf("\n 

prlntf("\n\n\n\n\n\n<") ; 
scanf("ld" ,&optlon) ; 

cls(); 

switch  (opcion)  ( 

case  0: 
return; 

case  l: 

n£  -  sx  -  sy  -  0; 
fx  -  fy  -  511; 
getcharQ ; 

princ£("\n  *****  STATIONARY  TARGET  *****"); 

prlntf("\n\n  Acquire  new  Image  (Y/N)?  >M); 
scanf(M%s" , temp) ; 

If  (cemp{0)  —  'Y*  M  temp(O)  —  'y')  ( 
grab(0) ; 
prtcQ; 
stopgrab(l) ; 

} 

break; 


*****  ACQUISITION  OF  IMAGES  *****\n") ; 
0: RETURN  TO  MAIN  MENU"); 

1: STATIONARY  TARGET"); 

2: MOVING  TARGET" ) ; 

3: LOAD  IMAGE  FROM  MEMORY"); 

6; SAVE  IMAGE  IN  DATABASE"); 

5: SET  CAMERA  PORT"); 

6: CAMERA  CHECK"); 

7 : RE- INITIALIZE  HARDWARE" ) ; 

8: LOAD  LARGE  IMAGE  FROM  MEMORY"); 


case  2: 

nf  -  0;  /*  this  algorithm  sets  sx,sy,fx,fy  to  target's  location  */ 
prlnt£("\n  *****  MOVING  TARGET  *****\n\n"); 

getcharQ ; 

prlnt£("\n  Prepare  background  Image"); 
prlntf("  and  press  RETURN  to  continue.  >"); 

waltvbQ;  /*  The  aclearQ  Is  used  In  this  routine  to  */ 

grab(0);  /*  clear  the  1st  16  columns  of  the  Image  */ 

getcharQ;  /*  because  of  an  X_SPIN  delay  of  the  Image.*/ 

stopgrab(l);  /*  Therefore  the  256x512  Image  Is  really  */ 
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socccg(X__SPIN,0) ;  /*  only  a  256x696  imago.  */ 

snap(l); 

acicar(0, 0,16, 768,0); 
socrog(SCROLL,256) ; 
princf("\n\n  Prepare  subject  image"); 
prlncf("  and  press  RETURN  co  continue.  >"); 

valtvbO;  /*  Scrolling  256  scores  the  background  image  */ 

grab(0);  /*  off  the  screen  area.  Scroll  0  brings  it  */ 

gocchar();  /*  back.  I  have  used  the  secreg  function  instead  */ 

scopgrab(l);  /*  of  scroll  because  of  the  problem  with  deflni-  */ 

sccrog(.K_SPIN,0) ;  /*  cions  in  the  library,  (see  the  comment  */ 

snap(l);  /*  obtained  when  linking  this  program).  */ 

acicar(0, 0,16, 512,0); 
secreg(SCROLL,0) ; 

princf("\n\n  Subtracting  images  and  locating  target."); 
oparea(0, 256, 512, 255,0, 0,512, 255, 5,1); 

If  (isolate (20, 8, 16)  0)  (  /*  Isolate  target  from  surroundings  */ 

prlncf("\n  Could  not  find  target.  Press  RETURN  co  continue.  >"); 

gcccharO; 
sx  -  sy  -  0; 
fx  -  fy  -  511; 
break; 

) 

carea(sx+l , sy+257 , fx-sx- 1 , fy-sy- 1 , sx+1 , sy+l , fx-sx- 1 , fy-sy- 1) ; 

aclear(0, 255, 512, 256,0); 

break; 

case  3: 

printf("\n  *****  LOAD  IMAGE  FROM  MEMORY  *****"); 

princf("\n\n\n  Enter  complete  file  specification."); 
princf("\n  (filename. ext; verslon)\n\n  >"); 
scanf("%s",  name); 
c2(0]  -  '\0'; 
strcat(c2, imagedir) ; 
strcat(t2,name) ; 
princf("%s\n",t2); 
prlntf("\n\n\n  Loading  file..."); 
if  (readim(200, 30, 200, 200, t2, "nocoma")  —  -1)  ( 
printf ("\n\n\n  File  not  found."); 
prcc(); 

) 

else  cext(200 ,10,0,1, 200 , "  \0"); 

nf  -  sx  -  sy  -  0; 
fx  -  fy  -  511; 
break; 

case  6: 

cl (0 )  -  '\0' ; 
strcat(tl, imagedir) ; 

prlntf("\n  Will  save  ******ENTIRE******  screen  as  8 -bit  image  in 

printf("  pixel  data  base.\n\n\n  Enter  name  (including  EXT)"); 
printf("/n  (Enter  Quit  to  exit)\n\n>") ; 
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scan f("*s",  name);  /*  I  vane  co  make  sure  chac  che  DBASE  */ 
if(scrcmp(n3«e, "Quic\0")  »«  0)  break; 

scrncae(cl,  name ,11);  /*  directory  Is  noc  couched  by  chls  save.  */ 
ptinef("\n\n\n\n  Saving  image...”); 

/*  Hence  che  direccory  name  is  */ 
saveiro(0, 0,511, 480,0, cl, "nocomra");  /*  noc  allowed  co  vary.  */ 
break; 

case  5: 

princf("\n  Selecc  camera  pore  (0,1  or  2)  >"); 
scanf("td" ,&cara) ; 

if  (cam  •  0  1 1  cam  —  l  1 1  cam  —  2) 
seccamera(cam) ; 
break; 

case  6: 

princf("\n\n  *****  CAMERA  CHECK  *****\n\nM) ; 

grab(0) ; 

prcc(); 

scopgrab(l) ; 

nf  -  sx  -  sy  -  0; 

fx  -  fy  -  511; 

break; 

case  7: 

inieializeO ; 
nf  -  sx  «•  sy  ~  0; 

fx  **  fy  ~  511;  /**************************************************/ 
sclear(lOO);  /*  using  100  gives  a  clean  screen  chac  is  noc  coo  */ 
break;  /*  dark  co  cell  whecher  che  monicor  is  on/off  */ 

case  8: 

princf("\n  *****  LOAD  IMAGE  FROM  MEMORY  *****"); 

princf("\n\n\n  Encer  coraplece  file  specificaCion. ”) ; 
princf(H\n  (filename. exc; vers ion) \n\n  >"); 
scanf(M%sM,  name); 
c2(0)  -  *\0' ; 
scrcac(t2,imagedir) ; 
scrcac(c2,naae) ; 
princf ("%s\n" , c2) ; 
princf("\n\n\n  Loading  file..."); 
if  (readim(0, 0,511, 480, c2, "nocomm")  —  -1)  { 
princf("\n\n\n  File  noc  found."); 
prcc(); 

) 

else  cexc(200, 10,0, 1,200, "  \0 " ) ; 

nf  -  sx  -  sy  -  0; 
fx  -  fy  -  511; 
break; 

defaulc:  /*  This  is  to  prevenc  accidently  leaving  it  on.  */ 

break;  /**********  **************************************** / 

)) 
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/**********************************************************************/ 


raonu3(/ 

l 

char  ccmp(80 j ,ch{80) , c3 { 80 J ; 
Inc  version, j ; 

for  (;;)  ( 

cls(); 

prlncf("\n 

prlntf("\n 

prlntf("\n 

prlncf("\n 

scanf("ld" ,&opclon) ; 

switch  (opclon)  ( 

case  0: 
re  cum; 

case  l: 

dlsplay(lllsc,k,6) ; 
prlncf("\n\n 


/*  A 02  */ 


*****  DEMONSTRATION  *****\n"); 

0: RETURN  TO  MAIN  MENU") ; 

1: IDENTIFY  A  PERSON"); 

2 ; TOTAL  SYSTEM\n\n\n\n\n\n\n>" ) ; 


*****  IDENTIFY  A  PERSON  *****"); 


prlncf("\n\n  Enter  person's  name  (or  Qulc).  >"); 

scanf("%s",temp); 

lf(scrcmp(cemp, "Quic\0")  —  0)  break; 

prlntf("\n\n  Enter  version  number.  >"); 

scant ("ts" ,ch) ; 

prlncf("\n") ; 

test  -  -l; 

for  (j-l;  j«k+l);  j-H-)  ( 

If  (scrncmp(iilsc( j ] .name, temp, II)  —0)  { 

If  (lllst(j ] .nua  —  (ch(0)  -  '0'))  ( 
t3 ( 0 j  -  '\0' ; 
strcat(t3, iraagedlr) ; 
strncat(t3, illst(j ] .name, II) ; 
strcat(t3 , " . img;\0") ; 
strcat(t3,ch) ; 
test  -  j ; 
j  -  k  +  2; 

))) 

If  (test  —  -1)  ( 

prlntf("\n\n  Image  file  not  found."); 
prtc() ; 

) 

else  { 

nf  -  sx  -  sy  -  0; 
fx  -  fy  -  511; 
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sclear(O.l) ; 

readlra(200 , 30 , 200 , 200 , t3 , "nocomm" ) 
text(200 ,10,0,1, 200 , comp) ; 
recognize (test) ; 

} 

break; 

case  2: 
afrmQ ; 
break; 

default: 

break; 

)) 

I 
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/*************************«********************************************/ 
static  inc  pix.avg.diff .neigh, threshold.ne.nn, run;  /*  469  */ 

static  int  col ( 5 12 J ; 
struct  image { 

int  data(512] ; 


); 

struct  feat) 

int  sx.sy, £x, fy, xcenter, ycenter, pix, xsi2e,ysi2e, used; 
J: 


struct  whole ( 

int  x , y , dx , dy , lcye , reye , teye , beye , tnose , cmouth ; 
int  center, xellipse, yell ipse .radius; 

); 

static  struct  image  plc(512) ,norm(512J , temp(512) ; 
static  struct  feat  eye) 100] , nose) 100) .mouth) 100] ; 
static  struct  whole  face(10]; 


/*£********************************************************************/ 
int  £acemap()  /*  485  */ 

l 


int  i.j.k.l; 
char  name (30); 

del(); 

cls(); 

printf("\n  processing  image..."); 
bright_norm() ; 
ne  ~  nn  -  nra  -  nf  -  0; 
featuremapO ; 

for  (i-1;  i<ne;  i++)  ( 
if  ( eye (i). used  ~  0)  ( 

for  ( j— 1 ;  j<ne+l;  j++)  (  /*  look  for  a  matching  eye  */ 

if  (eye(j).sx  >  eye[i].fx  &&  eye[j).used  —  0)  (  /*  try  eye(j)  */ 

if  (abs(eye(j ] .pix  -  eye) i]. pix)  <  eye[ j ) .pix/2)  (  /*  pix  numbers  */ 
if  (eye(j ) .ycenter  >  eye[i).sy  &&  /*  okay  */ 

eye(j ) .ycenter  <  eye(ij.fy)  (  /*  close  in  height  */ 

if  (eye(j).sx  <  eye[ i) . fx+2*eye(i) .xsire)  {  /*  near  enough  */ 

for  (k-1;  k<nn+l;  k++)  (  /*  look  for  a  nose  */ 

if  (nose(k).sy  >  eye[i].fy  &&  nose(k).used  —  0)  { 

/*  try  nose[k]  */ 

if  (nose[k) .xcenter  >  eye[i].sx  && 

nose[k) .xcenter  <  eye(j).fx)  {  /*  between  eyes  */ 

for  (1-1;  l<nm+l;  1++)  (  /*  look  for  a  mouth  */ 

if  (raouth(l) .ycenter  >  nose[k].fy  && 

mouth) i) .used  — —  0)  {  /*  below  nose  */ 

if  (mouth) 1) .ycenter  <  eye) i] .fy+4*eye(i) .ysi2e)  { 

/*  near  enough  */ 

if  (raouth(l) .xcenter  >  eye[i].sx  && 

mouth) 1) .xcenter  <  eye(j).fx)  {  /*  between  eyes  */ 

nf  -  nf+1; 

/*  all  features  found  and  conditions  met  for  a  face.  */ 
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eyeji).uscd  -  cye(j).used  -  1; 
nose Jk)  .used  -  mouchj 1) .used  -  1; 
facejnf) .dx  -  9*(eye{j j .xcencer  -  eye{l) .xcencer)/4; 
facejnfj.dy  -  2*(rnouthjl)  .ycentor  •  eyejij.sy); 
facejnfj.x  -  (eyeJJ ] .xcenter+eyej l) .xcenter)/2 
-  facejnf) .dx/2; 

facejnf ).y  -  mouch(l) .ycencer  -  4*face(nf ) .dy/5; 
facejnf j .lnye  -  eye(ij.sx  -  facejnfj.x; 
facejnf j .reye  -  eyejjj.fx  -  facejnfj.x; 
facejnf j . ceye  -  (eye{i].sy  +  eyejj).sy)/2  -  facejnfj.y; 
face jnf j .beye  -  (eyejlj.fy  +  ®y«jjj.fy)/2  -  facejnfj.y; 
face jnf j . tnose  «  nosejkj.sy  -  facejnfj.y; 
facejnf) .cmouch  -  mouthjl) .ycencer  -  facejnfj.y; 
face jnf) .center  -  facejnf j .dx/2; 
face jnf) .xellipsa  -  facejnf J .dx/2  +  facejnfj.x; 
facejnf j .yellipse  -  facejnf j .dy/2  +  facejnfj.y; 
face jnf j .radius  *•  facejnfj.dx; 
clrcle(facejnf) .xellipse , face jnf ) .yellipse, 
face jnf j .radius, 1,2,255) ; 

rectanglc(eyejl) .sx-l,eye(i) .sy-l,eye(j ) .fx  -  cye(i).sx, 
mouthjl) .ycencer  -  eyej i) .sy,255) ; 

1  -  k  -  j  -  500; 

nnmmnn 

if  (nf  —  0)  return(O); 

prlntf("\n  Saving  brightness  normalized  faces  co  disk..."); 
for  (y-0;  y<480;  y++)  uhline(0,y,512,norm(y) .daca) ; 
name J  0 )  -  '  \0 ' ; 
strcat(name, "bnorra. img\0B) ; 

for  (i-1;  i<nf+l;  i++)  { 
printf("\n  %s%s*dM .name, H ; " , i) ; 

/*  changed  255  to  0  for  fill  between  ellipse  and  rectangle  */ 
c ircle ( face ( i ) . xellipse , face ( i ) . yellipse , face ( i ) . radius ,1,2, 255 ) ; 
rectangle (facej i) .x.faceji) .y, facej i) .dx, face jij .dy,255) ; 
fill(faceji) .x+1, facej i) .y+1, 50, 255) ; 
fill(faceji) .x+1, facej i) .y+1, 0,255) ; 

fill(facejij .x+face(ij .dx-1, faceji) .y+face(i) .dy-l,50,255) ; 

fill(face j ij .x+face jij .dx-1, face j ij .y+face j ij .dy- 1,0, 255) ; 

fllljfacejij .x+1, face [ i J . y+face { i) .dy-1,50,255) ; 

fill(facejij .x+l,facejij .y+facejij .dy-1, 0,255) ; 

fill(faceji). x+face(i). dx-1, face JiJ.y+i, 50, 255); 

fill ( face [ i) . x+face (i) .dx-1, facej i) .y+1, 0,255) ; 

circle(faceji) .xellipse, face(i) . yellipse, faceji) .radius, 1,2,0) ; 

rectangle (facej i) . x, faceji] .y, facej i) . dx, face j i j .dy,0) ; 

saveim( facej i) .x, face Ji) .y, facej i J . dx, facej i) . dy ,0,name, "nocomra") ; 

) 

printf("\n  Also  saving  original  faces...'1); 
for  (y-0;  y<480;  y++)  whline(0,y, 512, tempjy) .data) ; 
name(O)  -  '\0*; 
strcat(name, "orig. img\0") ; 
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Coc  (l-l;  L<nf+1;  i++)  ( 
prlncf(M\n  tslsld'* ,naiae,H;M,t); 

recr.angle(face(l]  .x,£ace(l)  ,y,face[l)  .dx,£aee(l)  ,dy,255); 
savclm(face(i)  .x,face{ij  .y,face(l)  .dx.face(i)  .dy,0,name,',ncico8vi‘*l 

1 

rccurn(i) ; 

I 
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foacuccraapO  /*  563  */ 

{ 


Lnc  fill,  cesc.ymin, ymax, xmax,  l,  j  ,dy,dx,ycesc,xcesc,bx; 
char  cype; 

for  (y-sy+14;  y<fy-l4;  y-H-)  (  /*  begin  and  end  with  14  pixal  margins  */ 

rose  -  0; 

for  (x-sx;  x<fx-14;  x++)  (  /*  see  if  line  is  couching  cop  of  objecc  */ 

if  (pic(y+l)  .daca(x)  *—  0)  (  /*  chese  checks  are  done  like  chls  */ 

if  (plc(y) .daca(x)  —  100)  (  /*  for  speed,  */ 

if  (pic{y) ,daca[x-i)+pic(y) ,daca[x+lj  —  200)  ( 
if  (pic(y) ,daca(x-2]+plc(y) ,daca[x+2]  —  200)  ( 
if  (plc(y) ,daca(x-3]+pic(yJ ,daca[x+3)  •—  200)  ( 
if  (pic(y) ,daca(x-4)+plc(yJ ,daca[x+4)  —  200)  ( 
if  (ptc(y) ,daca(x-5j+plc{y) ,daca(x+5)  —  200)  ( 
cesc  «  1; 
bx  -  x  -  50; 
if  (bx  <  14)  bx  -  14; 
x  -  512; 

mini) 

if  (cesc  —  1)  {  /*  okay,  for  chis  line  find  che  objecc(s)  */ 

for  (x-bx;  x<498;  x++)  { 
cesc  -  0; 
cype  -  'u' ; 

if  (pic[y) ,daCa(x]  —  100)  {  /*  possible  corner  */ 

ymax  -  y  +  40; 
if  (ymax>479)  ymax  -  479; 

for  (i-y;  i<ymax+l;  i++)  (  /*  how  far  is  line  whice?  */ 

if  (pic( l) .daca(x)  —  0)  ( 
ymax  -  i  -  1; 
i  -  512; 

)) 

if  (ymax  >  y+1)  ( 
for  (i-y+1;  Kymax;  i++)  { 

if  (pic(i) ,daca[x+l)  —  0)  {  /*  someching  couching  line  */ 

dy  -  i; 

Cesc  -  1; 
i  -  512; 

)))) 

if  (  cesc  —  1)  (  /*  lefc  side  ok  */ 

xmax  -  x  +  50; 
if  (xmax>498)  xmax  -  498; 

for  (i-x;  i<xraax+l;  i-H-)  (  /*  how  far  is  line  whice?  */ 

if  (pic(y) .daCa(i)  --  0)  ( 
xmax  -  i-1; 
i  -  512; 

)) 

cesc  -  0; 
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if  (xraax  >  x+1)  ( 
for  (l«*x+l;  Kxmax;  1++3  l 

if  (pic(y+l) .daca( i)  —  0)  {  /*  something  couching  line  */ 

dx  «*  i; 
test  -  i; 
i  -  512; 

un 

if  (cost  *•«  1)  {  /*  at  the  border  of  unknown  object  */ 

test  *•  0; 

while  (dx  <  xraax+l  &&  dy  <  yraax+1  &&  test  —  0)  { 
ycest  «•  0; 

while  (dy  <  ymax+1  &&  ycest  —  0)  (  /*  cry  co  go  across  co  dx  */ 

ycosc  •  1;  /*  assume  success  */ 

for  (i-x;  i<dx+l;  1++) 
if  (plc(dy) .daca( l)  -*•  0)  ycest  **  0; 
if  (ycest  —  0)  dy  -  dy  +  1; 

) 

if  (ycest  —  1)  ( 
xcesc  -  0; 

while  (dx<xmax+l  &&  xcesc  —  0)  (  /*  cry  Co  go  down  co  dy  */ 

xcesc  -  l;  /*  assume  success  */ 

for  (i-y;  i<dy+l;  i++) 

if  (ptcji) .datajdx]  —  0)  xcesc  -  0;  /*  failed  */ 

if  (xcesc  —  0)  dx  -  dx  +  1; 

) 

if  (xcesc  —  1)  (  /*  recheck  present  dy  */ 

for  (l-x;  Kdx+l;  i++) 

if  (pic(dy) ,data(i]  0)  ycesc  -  0;  /*  failed  */ 

if  (xcesc  —  1  &&  ycesc  —  l)  tesc  -  1; 

)))) 

if  (cesc  --  1)  {  /*  successfully  blocked  in  object  */ 

if  ((dy-y)  >  3*(dx-x))  type  -  't';  /*  Coo  tall  and  chin  */ 

if  ((dx-x)  <  7)  type  -  'e';  /*  coo  small  */ 

) 

if  (cesc  —  1  &&  type  —  'u')  { 
fill  -  0; 

for  (j-y+1;  j<dy;  j-H-) 

for  (i-x+1;  i<dx;  i++)  if  (pic(j } ,data( ij  —  0)  fill++; 
if  (fill  <  (dx-x)*(dy-y)*3/10)  cesc  -  0;  /*  less  chan  30%  solid  */ 

) 

if  (tesc  —  1  £■&  type  —  'u')  { 

if  (dx-x  >  2*(dy-y))  {  /*  possible  mouth  */ 

rectangle(x,y,dx-x,dy-y,0) ; 
type  -  'ra' ; 
nra  -  run  +  1; 

mouch(nraj .xcenter  -  (dx+x)/2; 
mouth(nm) .ycenter  -  (dy+y)/2; 
mouch(nra) .sy  -  y; 
mouch(nm) .used  -  0; 

}) 
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if  (ccsc  «**  i  &&  type  !-  *  c ' )  ( 
fill  -  0; 

yraax  -  dy+(2*(dy-y)/3) ; 
if  (yraax  <  &80)  ( 

foe  (j-dy+l;  j<ywax;  J++)  /*  chic  for  space  below  */ 

for  (i-x;  Kdx;  i++)  if  (pic(j ) .daca(l)  —  0)  fill-H-; 
if  (fill<(yniax-dy+i)*(dx-x)*i0/i00)  ( 

/*  less  chan  10%  of  area  filled  */ 

cype  -  ‘o' ; 
ne  -  ne  +  1; 

cye(nej .xcencer  -  (dx+x)/2; 

eyejnej .ycencer  -  (dy+y)/2; 

eyejnej.pix  -  (dx-x)  *  (dy-y); 

eye j  ne  j . xs ice  -  dx  -  x ; 

eyejnej .ysize  -dy-y; 

eyejnej .sx  -  x; 

eyejnej .fx  -  dx; 

eyejnej. sy  -  y; 

eye  j  ne  j . £y  -  dy ; 

oye jne j .used  -  0; 

reccangle(x, y, dx-x, dy-y, 0) ;  /*  (lxl  <~  size  <-  20x20)  */ 

I) 

fill  -  0; 
yrnin  -  y-(dy-y); 
if  (yrnin  >  0)  ( 

for  (j -yrnin;  j<y ;  J++)  /*  chic  for  space  above  */ 

for  (i-x;  i<dx;  i++)  if  (pic(j J .data(i)  —  0)  fill++; 
if  (fill  <  (y-ymin)*(dx-x)*10/100)  ( 

/*  less  chan  10%  of  area  filled  */ 

nn  -  nn  +  1; 

nose(nn) .xcencer  -  (dx+x)/2; 

nose jnnj .ysize  -dy-y; 

nose jnnj . fy  -  dy ; 

nosejnnj .sy  -  y; 

nose jnnj .pix  -  (dx-x)  *  (dy-y); 

nosejnnj .used  -  0; 

reccangle(x, y, dx-x, dy-y, 0) ;  /*  (lxl  <-  size  <-  20x20)  */ 

mm 

re cur n; 

1 

/*  767  */ 
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/****ft#******A****^iM************^**********JHK*******************#**/ 
scaclc  double  cray(65] (65J ,crayr{65) (65) ,crayt(65) (65) ,rinp{65) ; 
scaclc  Inc  lx.iy; 


/k*iW*************^************M**iW*****iM:*******************i*******/ 
gcscnlc(ra)  /*  Values  range  from  0  co  128  */ 


Inc  ro;  /*  m  «  face  number  */ 

t 

Inc  x,y,l,J; 


Unc(256, 0,256, 512,0); 
llne(0, 256, 512, 256,0); 
llne(384,0,3S&, 512,0) ; 
llne(l28, 256, 128, 512,0); 


/*  lefe  half:  whole  head  */ 

carea(sx,sy,face(m) .dx/2, face (m) .dy,270,sy, face(m) . dx/2 , face ( ra ) . dy ) ; 

/*  rlghc  half:  whole  head  */ 

carea(sx+fnce(m) .dx/2, sy, face [ra] .dx/2, face (m) .dy, 

600, sy, face (m) .dx/2,face(ra] .dy); 

/*  cop  half:  cop  co  cnose  */ 

carea(sx,sy,face(ra) . dx, face [m] .cnose, 15, sy+256, face (m) .dx,face(m) .cnose) 

t 

I 

/*  Incernal  feacures  */ 

carea(sx+face(m] . leye, sy+f ace [ra] . ceye, face(m) .reye-face(m) .leye, 

face(m) .cmouch*face(m) .ceye, 

160+face(ra] . leye,sy+256+face(ra] . ceye, face [raj . reye-face(m) . leye, 

face(n) .cmouch-face(ra) .Ceye) ; 

/*  lefc  incernal  feacures  */ 

carea(sx+face(ra] .leye,sy+face[ra] . ceye, face (ra) . cencer- face [ra] .leye, 

face(m) .cmouch-face(m) , ceye, 
270+face[m] .leye, sy+256+face(ra] .ceye, face(ra) .cencer-face[n] .leye, 

face(ra) .craouch-facejra] .Ceye) ; 

/*  boccora  half:  cnose  co  chin  */ 

carea(sx,sy+face(ra] . cnose, face(ra] .dx, face(m) .dy-face(ra) .cnose, 

400,sy+256+face[ra] . cnose, face(ra) .dx,face(ra) .dy-face(ra] .cnose) ; 


line(sx,sy,sx+face(a] .dx,sy,0) ;  /*cop*/ 

line(sx+face[ra] .dx,sy,sx+face[ra) .dx,sy+face[ra) .dy,0) ;  /*righc*/ 

line(sx+face [raj .dx,sy+face(ra] .dy,sx,sy+face [raj .dy,0) ;  /*boceom*/ 

1 ine ( sx , sy+f ace { ra ] .dy,sx,sy,0) ;  /*lefc*/ 

line(sx,sy+face[nj .Ceye,sx+face(ra] .dx,sy+face(ra] .ceye,0) ;  /*ceye*/ 

line(sx,sy+face [raj .craouth, sx+f ace [ra] . dx, sy+f ace [m] .craouch,0) ;  /*cmouch*/ 
line (sx, sy+f ace [raj . Cnose, sx+f ace (ra) .dx,sy+face(ra] . cnose, 0) ;  /*cnose*/ 

line(sx+face[ra) . leye, sy,sx+face(ra] .leye, sy+face(ra] .dy,0) ;  /*leye*/ 

line(sx+face[raj . cencer, sy, sx+f ace [ra] . cencer, sy+face(mj .dy,0) ;  /*cencer*/ 

line(sx+face[raj .reye,sy,sx+face(raj .reye,sy+face[m) .dy,0) ;  /*reye*/ 

ix  -  face(ra) .dx/2; 
iy  -  face [raj .dy/2; 


princf("\n  calculacing  ffc  for  window  1."); 

clear_cray();  /*  lefc  half:  whole  head  */ 
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Cor  (y«sy;  y<sy+face[ra) .dy;  y+-2) 

for  (x-270;  x<270+face{ra) .dx/2;  x+-l)  { 

crayr(x-269]{l+(y-29)/2]  »  (double)  brplxel(x,y)/255; 

) 

ffc2(crayr,crayt,64,0) ; 
save_ffc(0) ; 

princf(M\n  calculating  ffc  for  window  2."); 

clear_cray();  /*  rlghc  half:  whole  head  */ 

for  (y-sy;  y<sy+face(m) .dy;  y+-2) 

for  (x-4Q0;  x<400+face(m) .dx/2;  x+«l)  ( 

crayr(  (x*399)+fnce(m)  .dx/4) (l+(y-29)/2) « (double)  brpixel(x,y)/255; 
I 

ffc2(crayr,crayl,64,0) ; 
save_f£c(i) ; 

prlncf(M\n  calculating  ffc  for  window  3.H); 

clear_cray() ;  /*  cop  half:  cop  co  cnose  */ 

for  (y-sy+256;  y<sy+256+face(m) .  cnose;  y+-l) 
for  (x-15;  x<15+face[ra) .dx;  x+-2)  { 

crayr[l+(x-l4)/2) (y-285 j  -  (double)  brplxel(x,y)/255; 

J 

£fc2(crayrtcrayi,64,0) ; 
save_££c(2) ; 

prlncf("\n  calculating  ffc  for  window  4."); 

clear_cray() ;  /*  Incernal  features  */ 

for  (y-sy+256;  y<sy+256+face(m) .cmouch;  y+-2) 
for  (x-140;  x<140+face(ra) .reye;  x+-2)  { 

crayr(l+(x-l39)/2] ( l+(y-285)/2)  -  (double)  brplxel(x,y)/255; 

) 

£fc2(crayr,crayi,64,0) ; 
save_ffc(3) ; 

prlnc£("\n  calculating  ffc  for  window  5."); 

clear_cray() ;  /*  left  incernal  features  */ 

for  (y-sy+256;  y<sy+256+face(m) .cmouch;  y+-2) 
for  (x-270;  x<270+face{n] .dx/2;  x+-l)  { 

crayr[x-269] [l+(y-285)/2]  -  (double)  brplxel(x,y)/255; 

) 

ffc2(crayr,crayi,64,0); 
save_ffc(4) ; 

prlntf("\n  calculating  fft  for  window  6."); 

clear_cray() ;  /*  bottom  half:  tnose  to  chin  */ 

for  (y-sy+256;  y<sy+256+face[ra) ,dy;  y+-l) 
for  (x-400;  x<400+face(ra] .dx;  x+-2)  ( 

crayr(l+(x-399)/2] (y-285)  -  (double)  brpixel(x,y)/255; 

) 

£fc2(crayr,crayi,64,0) ; 
save_fft(5) ; 

return; 
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} 


save_ffc( Index) 
int  index; 


( 

inc  x,y; 

for  (x~0;x<5;x++) 
for  (y-0;y<5;y++) 

iUst(0).fcacure(index}(x){y)  *»  0,0; 
for  (x«0;x<3;x++) 
for  (y-0;y<3;y++> 

illst(O) . feature) index) (x+2) )y+2)  -  crayr(x)(y); 
for  (x«0;x<2;x'f+) 
for  (y-0;y<2;y*+) 

illstjo). feature) index) (x+3](y)  -  crayr(x+l) (y+62) ; 
for  (x~0;x<3;x++) 
for  (y-0;y<2;y4-+) 

llist(O). feature) index) (x)(y)  -  crayi(2-y) (2-x) ; 
lllst(O) .feature) index] (0 ) (2)  -  crayi(0](2); 
ilist(O) .feature (index) (1) )2 j  -  crayi(0)(lj; 
for  (x-0;x<2;x++) 
for  (y-0;y<2;y++) 

iiist(O). feature) index) (l-y))4*x)  -  crayl(x+62) (y+1) ; 

return; 

) 

/★**■***★★*■****■*★**■**•*+*★★•*♦**•***•**★*★★★★***★*★★★+★*★★*****★*****  *■*****★/ 
clear  cray() 

( 


Inc  x,y; 

for  (y~0;  y<65;  y++) 
for  (x-0;  x<65;  x-H-)  ( 
cray(x) (y)  -  0.0; 
crayr(x) (y)  -  0.0; 
crayi{xj(yj  -  0.0; 

) 

return; 

) 
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f f c2 (pice, iplcc.n, dir) 


double  plcc{65) (65) ; 
double  lplcc(65)(65); 
Inc  n; 

Inc  dir; 

( 


double  pic(65] ; 
double  lpic(6S]; 

Inc  t.j; 

for  (l  ~  0;  L  <  n;  1++) 

( 

for  (J  -  0;  J  <  n;  j++) 
t 

plc(j+l)  -  plcc(i)(J); 
iptc(j+l)  -  ipicc{ l] {j ) ; 

) 

ffc(pic, ipic.n.dlr) ; 

for  (j  **  0;  j  <  n;  j++) 

( 

picc ( i ] ( j  J  -  plc(j+l); 
ip  ice ( I } ( j  J  -  iplc(J+l); 
J 

) 

for  (j  -  0;  j  <  n;  j-H-) 

t 

for  (l  -  0;  1  <  n;  i++) 

{ 

pic ( 1+1)  -  picc(i)(j); 
iPic(i+l)  -  ipiccl LJ ( j  J ; 
) 

ffc(pic, ipic.n.dlr) ; 

for  (i  -  0;  i  <  n;  i++) 

{ 

picc(i) (j )  -  pic[l+l); 
ipicc[i)(jj  -  ipic(i+l); 
) 

) 

recurn; 
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££c(£r,£l,n.dir) 
double  fr ( 65 1 ; 
double  £1(65); 

Inc  n; 

Inc  die; 

t 

double  er-0,  ct-Q; 
double  vr-0,  vl-0; 
double  ol-O,  a-0; 
Inc  1-0,  J-0; 

Inc  mr«0; 

Inc  1-0; 

Inc  k~0; 

Inc  m-0,  nn-0; 

Inc  sccp-0; 


l£  (dir  <  0  ) 

for  (l  «  l;  l  <  n+l;  1++) 
fl(l)  -  -fl(l); 

«r  -  0; 
nn  -  n  -  1; 

for  (a  -  1;  m  <-  nn;  m++) 

( 

l  «  n/2; 

while  (1  +  mr  >  nn)  1-1/2; 
mr  -  rarll  +  1; 

If  (mr  >  m  ) 

( 

cr  -  fr[m+l); 

£r(m+l)  -  frjmr+l); 
fr[rar+l)  -  cr; 

cl  -  fl(m+i] ; 
fl(ra+l)  -  fl(mr+l); 
fl|rar+i)  -  cl; 

) 

) 

1  -  1; 

while  (1  <  n) 

( 

seep  -  2*1; 
el  -  1; 

for  (a  -  1;  a  <-  1;  m++) 

( 

a  -  3.1415926535  *  (double)  (1-m)/  el 
wr  -  cos(a) ; 
wt  -  sln(a) ; 

for  (1  -  a;  1  <-  n;  l  +-  seep) 

( 

j  -  1  +  1; 
k  -  i; 
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er  -  vr*£r(jl  -  «t*£i(j); 
cl  «  vc*fl{j)  +  vl*fr(J); 
fr(j)  -  fr(k)  »  cc; 

£L(j)  -  £l(k)  -  cl; 
fr(k)  -  fr(k)  +  cc; 
fl[k)  -  f t ( k)  +  cl; 

1 

) 

l  «*  seep; 

1 

If  (  dir  <  0) 

for  Cl  «  l;  l  <  n+l;  1++) 

{ 

fr[I)  -  fr(l]/n; 
fl(l)  -  - f l ( l)/n; 

1 

re  cum; 

1 


/*  697  */ 
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/ft«**********************************ft***************4**ft£ft£*******«*&ft/ 

brlghc_norm() 

t  /*  norm  will  concain  brightness  normalised  scene  */ 

/*  (bright  areas  sec  to  128,  dark  areas-  128-dlff  */ 
Inc  l,j;  /*  pic  will  concain  Che  dark  objeecs  of  chc  scene  */ 

/*  (uses  variable  threshold,  binary  oucpuc)  */ 

sx  -  sx  -  14; 

If  (sx  <  0)  sx  -  0; 
sy  -  sy  *  14; 

If  (sy  <  0)  sy  -  0; 
fx  -  fx  +  14; 

If  (fx  >  512)  fx  -  512; 
fy  -  fy  +  14; 

If  (fy  >  480)  fy  -  480; 

for  (y-0;  y<480;  y++)  for  (x«0;  x<512;  x++)  norra(y) .daca(x)  -  0; 
for  (y-0;  y<4S0;  y++)  rhline(0,y,5l2,plc[y) .data) ; 
y  -  sy; 

for  (l-sx;  Kfx;  1++)  ( 

col(L)  -  0;  /*  secup  all  columns  for  flrsc  y  value  */ 

for  (j-y;  J<y+30;  j++)  col(l)  +-  plc(j ) .daca(l) ; 

) 

for  (y-sy+1;  y<fy-30;  y+-f)  (  /*  now  all  columns  calculated  faster  */ 

for  (l-sx;  Kfx;  1++)  col(l)  +-  (plc(y+29) .data(l)  -  plc(y-l) .data(l)) ; 
x  -  sx; 

neigh  -  0;  /*  setup  flrsc  neighborhood  */ 

for  (l-x;  Kx+30;  1++)  neigh  +-  col(l); 

for  (x-sx+l;  x<fx-30;  x++)  {  /*  now  all  other  neigh  calculated  faster  */ 
neigh  +~  (col(x+29)  -  col(x-l)); 
avg  -  nelgh/900; 
plx  -  plc(y+14) ,data(x+14) ; 

If  (plx  <  avg)  norm(y+14) .data(x+14)  -  128  -  (avg  -  plx); 
else  norra(y+14) .data(x+14)  -  128; 

If  (norm(y+14J .data[x+14)  <  0)  norm[y+14) .data(x+14]  -  0; 

/*  added  variable  threshold  */ 

threshold  -  80*avg/100  +  thr;  /*  add  7  because  noise  Is  +/-  7  */ 

If  (plx  <  threshold)  temp[y+14]  .data[x+14)  -  0;  /*  dark-0  */ 

else  temp(y+14] . data[x+14]  -  100;  /*  else  llght-100  */ 

)) 

for  (y-sy+14 ;  y<fy-14;  y++)  (  /*  cleanup  noise  */ 

for  (x-sx+14;  x<fx-14;  x++)  ( 
plc(y) .data(x)  -  temp(y) .data(x) ; 

If  (temp(y) .data(x)  —  0)  { 

If  (tempfy] .data(x-l)+temp(y) .data(x+l]+temp(y) .data(x+2)  >0)  ( 
plc[y] .data[x)  -  100; 

)))) 

for  (y-sy+14;  y<fy-14;  y++)  { 
for  (x-sx+14;  x<fx-14;  x++)  ( 
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tf  (plc(y) .daca(x)  •—  0)  ( 

tf  (plc(y) .daca{x-l)+ptc(y-l) ,dacatx)+pic(y+l) ,daca(x)+ 
picjyj .daca(x+lj  >  200)  { 
pic(y) .daca(x)  -  100; 

)))> 

for  (y-fy-14;  y>sy+14;  y--)  ( 
for  (x-fx-14;  x>sx+14;  x--)  { 

If  (pic(y) .daca(x]  —  0)  { 

tf  (ptc(y) .daca[x-l]+plc(y-l) .daca[x)+pic[y+l} ,daca(x)+ 
ptc[yj .daca[x+lj  >  200)  ( 
ptc(y) .daca(x)  -  100; 

11)1 

for  (y-0;  y<A80;  y++)  rhline(0,y,512,cemp(y) ,daca) ; 
for  (y->0;  y<680;  y++)  whllne(0,y,512Iptc|y)  .daca) ; 
rccurn; 

) 
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cont_cnhance(ra) 


Int  m;  /*  face  number  */ 


I 


Infc  x,y,z; 


statlc_luts() ; 
setlut(RED,5) ; 

hlsteq(RED , 5 , face(ra] . leye+sx+l , face[m) .beye+sy, 

face[m].dx/2  *  2, face(ra) .cmouth-face(m) .beye) ; 
maplut(RED, 5,0,0,256,256) ; 


ilnlut(RED,5); 
Unlut(GREEN.5); 
Unluc(BLUE,  5) ; 


for  (y-sy;  y<sy+face(m] .dy;  y++)  ( 
for  (x~sx;  x<sx+face{m) ,dx;  x++)  { 
z  -  brplxel(x.y) ; 

If  (z  <  50)  bwpixel(x,y,z) ; 
else  bwpixel(x,y,255) ; 


/*  threshold  result  */ 

/*  leave  dark  areas  but  */ 
/*  make  skin  pure  white  */ 


return; 

J 
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scale(m) 

inc  m; 


( 

Inc  face; 

If  ((fx*sx)/150  >  (fy-sy)/150)  face  -  150/(fx-sx); 
else  face  -  150/(fy-sy); 

If  (face  >  1)  ( 

repzoom(sx , sy , fx- sx , fy-sy , sx , sy , 200 , 200 , f ace , fac  c) ; 

face(ra).dx  -  face(m].dx  *  face;  /*  updace  face(m) .lines  by  'face'  */ 

face(raj.dy  *•  face(m).dy  *  face; 

facejraj.lcye  -  facejraj.leye  *  face; 

facejmj.reye  -  facejmj.reye  *  face; 

face[mj.ceye  -  face (raj . ceye  *  face; 

facejraj  .beye  **  facejraj  .beye  *  face; 

face jraj . cnose  -  face(ra) . cnose  *  face; 

facejraj .cmouch  -  face(ra) .cmouch  *  face; 

facejraj  .ceneer  -  face jinj  .cencer  *  face; 

fx  -  (fx-sx)*facc  +  sx;  /*  updace  fx.fy  by  'face'  */ 

fy  -  (fy-sy)*face  +  sy; 

) 

aclear(0(0,512,sy,255) ; 
aclear(0,fy,512,480-fy,255) ; 
aclearjo.sy-l.sx, fy-sy+1,255) ; 
aclear ( fx , sy- 1 , 512  - fx , fy-sy+1 ,255) ; 

recurn; 

) 
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facercc(version) 

Inc  version; 

{ 

char  ch{80) , c2(30J . c3(80) , c4(30] » c5£80) ; 
inc  i,j w2,l,ra,n,p,dx,dy; 

if  (nf  !~  0)  ( 
cis(); 

princf("  crying  co  recognize  faces  found..."); 
for  (m-L;  m<nf+l;  m++)  { 

c2(0)  -  *\0';  /*  creace  file  names  for  face  a  m  */ 

c4  { 0  ]  -  *\0' ; 

scrcac(c2 , "bnorm. img;\0") ; 
scrcac(c4,"orig.img;\0") ; 
c3(0)  -  m  +  '0' ; 
c3(lj  -  *\0* ; 
scrcac(c2, c3) ; 
scrcae(c4, c3) ; 
sx  -  60; 
sy  -  30; 

princf("\n  %s",c2); 
sclear(0,l) ; 

readim(sx,sy,200,200,c2,"nocomaH);  /*  display  brighC_norm  face  */ 

l  -  sy; 

while(brpixel(sx, 1)  !-  0)  1++;  /*  gee  fx,fy  values  */ 

fy  -  1  -  1; 

1  -  sx; 

whlle(brpixel(l,sy)  !-  0)  1++; 
fx  -  l  ■  1; 
dx  -  fx  -  sx; 
dy  -  fy  -  sy; 

/*  conC_enhance(ra) ; 
scale  (in);  */ 
cexc(70,10,0,l,0,c2) ; 

gescalc(m);  /*  gesCalC  values  puc  in  ilisc[0)  */ 

inicialize() ; 
sclear(0, 1) ; 

readin(200, 30, 200, 200, c4, "nocoma");  /*  display  original  face  */ 

cexfc(200,10,0,l,200,c4) ; 
if  (version  —  1)  { 
princf("\n  Save  in  dbase?  (Y/N)  >"); 
scanf ("%s" ,ch) ; 

if  (ch(0)  —  'y'  ||  ch [ 0 ]  —  'Y')  ( 
princf("\n  encer  name  of  subjecC  (up  Co  10  leccers)  \n>"); 
scanf ("%s" , C3) ; 

p  -  0;  /*  highesc  exiscing  version  #  for  chis  subjecC  */ 

for  (n-1;  n<k+l;  n++)  { 

if  (sCrncrap(ilisc{n) .name, c3 , 11)  --  0)  ( 
p  -  ilise.{n]  .nua; 

) 
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) 

k  -  k  +  i; 

P  -  P  +  1; 

ilist(k) .name(Q)  -  '\0' ; 
strncat(ilist(k) .name,t3,ll) ; 
ilisc(kj .nun  -  p; 
for  (w-0;  w<6;  w++) 
for  (wl~0;  wl<5;  vl++) 
for  (w2-0;  v2<5;  w2++) 

ilist(k) .  feature(v)  (wl)  [w2  j  -  ilist(0] .  feature(v)  (wl)  (w2) ; 
others  changed  -  'c'; 
c5(0)  -  *\0'; 
scrcac(c5 , imagedir) ; 
strncat(t5, ilist[kj .name, 11) ; 
s  crcac( c5 , " . img ; \0" ) ; 
saveim(200, 30, 200, 200,0, t5,"nocomm") ; 

) 

) 

else  { 

if  (ra  <  nf)  ( 

printf("\n  Forget  about  rest  of  "); 
printf(“faces  and  return  to  main  menu?  (Y/N)  >"); 
scanf("%s" ,eh) ; 

if  (ch [ 0 ]  —  *y*  ||  ch(0 j  —  'Y')  ( 
return; 

) 


recognize(O) ;  /*  pass  in  gestalt  values  of  llist(0)  */ 

delete(t2) ; 
delete(t4) ; 
cls() ; 

)) 

else  ( 

printf("\n  face  not  found."); 
prtc(); 

I 

nf  *•  sx  -  sy  -  0; 
fx  -  fy  -  511; 
return; 

I 
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scacic  inc  resulcsl(257) (5J ; 

scaclc  Inc  llsc(lOl);  /*  Use  of  ides  ordered  by  distances  In  llsc2  */ 
scacic  double  c(10lj ,lisc2(l0l) ;  /*  cocal  distances  (for  all  windows)  */ 
scaclc  double  v( 101 ) ( 7 ) ;  /*  v(id)(w)  «  distance  from  person  *td  co 

unknown  person  for  window  #v  (Russel,  1985:4*40a)  */ 


y*************************ibt******A**A***A************A*'****)k**'***'A****/ 

recognize(nura)  /*frora  REMID.FR  06/03/86  by  R.  Russel  */ 


Inc  num; 


/*  the  position  in  illsc[)  of  gestalt  values  co  use.  */ 


( 

char  c8 ( 80 ) ; 

double  glx, gux, siglx.c, most; 
inc  id.w.x.y.m.n, j .confid, cesc; 

double  p ( 7 }  -  (1.0, 1.0, 1.0,1. 0,1, 0,1. 0,6.0) ;  /*  window  performance  factors 
(update  afeer  crainlng  and  testing  with  sufficient  samples  */ 
/*  noce:  p{0)  is  used  for  cocal  of  factors  */ 

print£(M\n\n\n  Now  crying  co  recognize  subject  in  cop  half  of  screen. \nM); 
prlncf("\n  Presently  trained  with  %d  subjects. M , (1/4)) ; 

for  (w-0;  v<6;  w++)  ( 
for  (td-lj  ld<(i/4)+l;  id++)  ( 
m  -  ld*4  -  3; 
c-0; 

for  (x-0;  x<5  ;  x-H-)  ( 
for  (y-0;  y<5;  y++)  ( 

gix  -  (  (double)  (clisc(mj .feature(w) (x) (y)  + 

tlistjra+l] .feature(w) (x) (yj  + 
clist(m+2) . feacurejw] [xj (yj  + 
clisc(m+3) . feature(w) (xj [yj  )/4.0) ; 
gux  -  (double)  ilist(num) . feature(w) (xj [yj ; 

/* 

VOTING  SCHEME 

Voting  can  be  done  on  four  consecutive  test  feature  sets 
(consecutive  is  ilist) .  Substitute  this  assign  statement 
for  the  variable  gux. 

gux-  (  (double)  (ilist(num] . feacure(w) [x] (y)  + 
ilise(num+l) .featurejw) (x] (y ] 
ilist(num+2 j . featurejwj (xj (yj 
ilistjnura+3 j .featurejwj (xj (yj  )/4.0) ; 

*/ 


sigix  -  (  (double)  (abs(gix-tlist(m] .feature(w) (x) (y))* 
abs(gix-tlist[ra] . feature(w) (x) (y) )+ 
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abs(gix-cUsc(ra+l) .  feature (v)  (x) (y))* 
abs(gix-cUsc(m+l  j .  feature! wj  [x  j  |yj )+ 
abs(gix-cliscjra+2j .  feature jwj  [xj  |yj)* 
abs(gix-cHsc(ra+2)  . feature [vj  (x)(y))+ 
abs(gix-cllsc(mf3) . feature jwj [xj (yj)* 
abs(gix-ciist|ra*3) .featurejwj [xj  [yj)))/4.0; 

sigix  -  sqrc(sigix); 

If  (slglx  <  .5)  sigix  «  .5; 

c  +-  (gix-gux)*(gix-gux)/(4*siglx*slglx); 


I 

J 

v(Ld)(v]  -  «sxp(-1.0*c/10000)  *  p(w) ; 


) 

) 

for  (id-1;  id<(i/4)+l;  id++)  { 
c[idj  -  0.000000001; 
for  (w-O;  w<6;  w++)  { 
c( id)  +-  v( id) (w) ; 

) 

c[id)  -  c[ id )/p ( 6 ) ; 

/*max  c[  id}  -  1.0  when  distance  from  id  to  unknown*/ 

J  /*  individual  -  0.0  */ 

/*  printf(M\nSorting  Distances  %2d",t);  */ 

/*  now  have  all  distances  ordered  by  id#,  need  to  order  id#s  by  disc  */ 
for  (m-1;  ra<101;  rcf+)  ( 
lisc(ra)  -  0; 
lisc2[m)  -  0.000000001; 

I 

for  (m-1;  ra<((i/4)+l)  &&  m<16;  ra++)  ( 
most  -  0.000000001; 
for  ( j  — 1 ;  j<(i/4)+l;  j++)  { 
if  (c[j)  >  most)  { 
most  -  t(j ) ; 
n  -  j; 

1 

) 

list(m)  -  n;  /*  id  #  */ 

list2[m)  -  t[n);  /*  distance  */ 

t[n)  -  0.000000001; 

) 

/*  now  have  ordered  list  of  candidates,  need  to  display  them  */ 
test  -  0; 

if  (list2[l)  >  0.001)  { 

printf("\n\n  Candidate  Distance"); 

/*  printf("  Confidence");  */ 

for  (m-1;  m<((i/4)+l)  &&  m<16;  m++)  ( 
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If  (iisc2[ra}  >  0.001)  l 
Lf  (ra  »—  1)  ( 

prtncf("\n  1st  Choice:  "); 
c8(0)  -  *\o'; 
scrcac(c8 .dbasedir) ; 

5crcac(c8,cllsc(lisctl)*4  -  3). name); 

scrcac(c8," .pic\0") ; 

readira(50 , 286 , 200 , 200 , c8 , "nocomra" ) ; 

ccxc(50, 266, 0,1,200, clist[llsc(l)*4  -  3). name); 

cesc  *»  1; 

J 

If  (ra  —  2)  { 

princ£("\n  2nd  Choice:  M); 

cS(0)  «  *\0* ; 

scrcat(c8, dbasedir) ; 

scrcAC(c8,cllsc(iist(2)*4  -  3). name); 

scrcac(c8,".pic\0H) ; 

read lra(200 ,286,200, 200 ,  c8 ,  "noc„‘.raraH ) ; 

texc(200, 266,0, 1,200, cilsc{lisc( 2 )*4  -  3). name); 

cesc  -  2; 

) 

if  (ra  —  3)  { 

princ£("\n  3rd  Choice:  "); 

c8(0)  -  '\0* ; 

scrcac(c8, dbasedir) ; 

scrcac(c8,clist(lisc(3)*4  -  3). name); 

strcat(t8,".plc\0") ; 

readim(350, 286, 200, 200, c8, "nocomra") ; 

cexc(  350, 266,0, 1,200,  disc  [  llst(  3  ]*4  -  3).narae); 

cesc  -  3; 

) 

if  (ra  —  4)  printf("\n  Ochers:  M); 
if  (ra  >  4)  prinCf("\n  H); 

/*  confid  -  based  on  disCance  of  chis  candidate  and 

disCances  Co  nexc  candidates  */ 
princf(M%lls  %f" , tlist[list[ra]*4  -  3] .narae,list2(ra]) ; 
/*  printf(M  %d" .confid) ;*/ 

) 

else  ra-200; 

) 

) 

if  (test  —  0)  { 

printf("\n\n  Could  not  find  any  close  enough  candidates."): 
printf("\n  The  computer  has  never  seen  this  person  before."); 

) 

if  (  test  <  3  &&  Cest  !-  0)  ( 

princf("\n\n  Could  not  find  any  more  close  enough  candidates  so" 
if  (Cest  --  1)  printf("\n  only  displayed  1  picture."); 
else  printf("\n  only  displayed  2  pictures."); 

) 

prtc() ; 
return; 

) 
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/****★****★* *********  *Tt****^*****lW****************lHnk*A***Tk**********/ 

Inc  lsolace(thresh, mode, size)  /*  works  on  cop  half  of  screen  only!  */ 

inc  thresh;  /*  threshold  for  detection  of  target  */ 

Inc  mode;  /*  6  bLc  or  8  blc  image  */ 

Inc  size;  /*  determines  minimum  size  of  cargec  and  affects  speed.  */ 


! 

Inc  x.y.z; 


/*  size  Is  either  16  or  32  pixels.  */ 


sx  •*  sy  *•  fx  m  fy  **  -l;  /*  Find  cop.  *****************************  */ 


for  (y-slza-l;  y  <~  255;  y~y+stze)( 
for  (x  -  0;  x  <  511;  x~x+slze)( 
z  -  brplxcl(x,y); 

If  (mode  6)  z  **  z  &  63; 

If  (z  >-  thresh)  l 
sy  -  y-(slze-l); 
x  «•  512; 
y  -  512; 

m 


/*  This  subroutine  finds  location  */ 
/*  of  a  moving  object.  If  there  Is*/ 
/*  no  moving  object,  or  It  Is  coo  */ 
/*  small  then  (0)  Is  returned.  If  */ 
/*  an  object  Is  found  then  sx.sy,  */ 
/*  fx.fy  are  set  and  (1)  Is  re-  */ 
/*  curned.  This  Is  done  so  chat  */ 
/*  all  future  work  done  on  a  scene*/ 


/*  Is  done  on  a  greatly  reduced  */ 
If  (sy  -l)  return(O);  /*  area  of  the  scene  and  hence  Is  */ 

for  (y-256-slze;  y>(sy+size-l) ;  y-y-slze)( 

/*  done  faster.  Thresh  Is  set  to*/ 
for  (x  -  0;  x  <-  511;  x-x+slze){  /*  high  enough  value  to  eliminate  */ 
z  -  brplxel(x.y) ;  /*  video  noise  but  low  enough  to  */ 

If  (mode  —  6)  z  -  z  &  63;  /*  find  small  brightness  dtfferen-*/ 


If  (z  >-  thresh) ( 
fy  -  y  +  slze-l;  /*  Find  bottom, 
x  -  512; 
y  -  -i; 


/*  ces  that  may  occur  between  a  */ 
*  moving  object  and  Its  bkgnd.  */ 

/**********************************/ 


If  (fy  <  (sy  +  size))  return(O); 

for  (x-slze-l;  x  <-  511;  x-x+slze){  /*  find  left  side  */ 

for  (y  -  0;  y  <  255;  y-y+slze){ 
z  -  brpixel(x.y) ; 

If  (mode  —  6)  z  «•  z  &  63; 

If  (z  >-  thresh) { 
sx  -  x  -  (slze-l) ; 
x  -  y  -  512; 

))) 


If  (sx  —  -1)  return(O); 

for  (x  -  512-size;  x  >  (sx  +  size-1);  x  -  x  -  size)( 
for  (y  -  0;  y  <  255;  y  -  y  +  size)!  /*  find  right  side  */ 

z  -  brpixel(x.y) ; 

If  (mode  —  6)  z  -  z  &  63; 
if  (z  >-  thresh)! 
fx  -  x  +  size-1; 
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x  -  *1; 
y  -  512; 

m 

if  (fx  <  (sx  +  size))  rccurn(O); 
rocurn(l); 

> 


/*■**•*■****•***•* **lM****+**iM*TM*********^*']fr******'*  •*-******+**♦**■*■*  ik*****#**/ 


“define  AO  (shore  Int)nO(l) 
“define  aO(l)  (i  &  0x003f) 
■define  Ai  (shore  inc)al(i) 


/*  These  are  che  cransformaclons  used  in  */ 
/*  che  feodback  luc  for  che  real  time  */ 
/*  subcraccion  demo.  This  sofeunre  «as  */ 
/*  cteaced  by  using  che  coolbox  */ 
((l  &  OxOfcO)  »  6)  /*  program  (see  FG-100  user's  */ 

t  daca  A-  OxffcO;  daca  |-  (l  A  0x003f);  J 

/*  manual  chape  7)  */ 

■define  Ol(i)  (  daca  A-  0xf03f;  daca  ((1  «  6)  A  OxOfcO) ;  1  /********/ 


“define  al(i) 
■define  00(1) 


■define  INPUT  0x6000 

■define  abs(l)  (((l)  <  0)  ?  (-(1))  :  (l)) 


xfom\(addr,  initial) 
unsigned  addr, initial; 
l 

register  unsigned  short  i  -  addr; 
register  short  ins  data  -  initial; 
Dl(Al) ; 

D0(abs(Al  -  AO)); 
recurn( (unsigned)data) ; 

) 


xform2(addr,  initial) 
unsigned  addr, initial; 

( 

register  unsigned  short  i  «  addr; 
register  short  inc  data  -  initial; 
D1(A0); 

D0(abs(Al  -  AO)); 
recurn((unsigned)data) ; 

) 
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afrn()  /*  A  cosplecely  Aucanoaous  Face  Recognition  Machine  (AFRM)  */ 
l 


inc  cant; 

char  ccop,ansver(i] ; 
register  unsigned  j ; 

scop  ♦*  *n' ; 
cam  «  9; 

while  (cam  !*•  0  A&  can  !*•  I  &&  can  1«  2)  { 

prlncf(°\n  Selecc  canera  pore  (0,1  or  2)  >"); 
scanf(’11id*‘.6cam) ; 

I 

while  (scop  **-  *n*)  ( 
cls(); 

prlncf("  please  wale..."); 
rcsubcracc(O); 
seccamera(cam) ; 
secluc(0,0) ; 
seclnmux(6) ; 

for  (j-0;  j <0x1000;  J++)  wrlceJ.uc(INPUT,J ,xfor*2(J ,read_luc( INPUT, j))) ; 
cls(); 

prlncf(H  looking  for  cargec."); 
snap(l) ; 
snap(l) ; 

while ((Iso lace (8, 6 ,32))  !~  1)  snap(l); 
princf("\n  found  cargec,  acquiring  8  blc  Image."); 

IniclallzeO ; 
seccamera(cam) ; 
walcvbO ; 
snap(l) ; 

nf  -  sx  -  sy  -  0; 
fx  -  511; 

fy  -  255;  /*  presently  Isolate ()  only  looks  for  cargec  In  cop  */ 

If  (faceraapQ  —  l)  (  /*  half  so  look  for  faces  In  cop  half  */ 

prlncf("\n  found  "); 
prlncf("%d" ,nf) ; 

If  (nf  —  1)  prlntf("  face."); 
else  prlntf("  faces."); 
facerec(2) ; 

) 

princf("\n  Do  you  wish  to  scop?  (Y/N)  >"); 
scanf("%s" .answer) ; 

If  (answer(0}  — >  'Y'  ||  answer(0]  —  'y')  scop  -  'y'; 

) 

return; 

) 
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del() 

{ 

prlncf(M\n\n  Deleting  files  with  reserved  names. H); 

syscem(Mdelete  bnorm.lng;*’'); 

/*  these  names  are  reserved  for  faceflnder  */ 

systcm("delece  orlg. lmg;*"> ; 
return; 

J 

/**-*A***********************ilhk****i**+******iWr**************************/ 

prccO  /*  6S5  v 

l 

prlntf("\n\n  Press  RETURN  to  continue.  >"); 

getcharC); 

gecchacQ ; 

return; 

J 


y**********************^********!^**************************^***** ******/ 


cls() 

( 

prlntfC" \n\n\n\n\n\n\n\n\n\n\n\n\n\n\n " > ; 
pr Inc  f ( M \n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n\n  H ) ; 
recurn; 

J 
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/**************•**************  **************  ^Vt****^****************#***/ 
Inc  read£fcfile(name,scr) 
char  narae{ ] ; 
struct  Use  scr( ) ; 
t 

char  c, Lnscring(lO) ; 

FILE  *fp; 

Lnc  h.l.J .k, 1 ,x; 
double  y; 

£p  **  fopen(name,MrM) ; 

£scanf(fp,MldM,&h); 
for  (L»l;L<h+L:i++)  { 

£scanf(fp, HllOs" .Unstring) ; 
for  (j"0;j<lO; j++) ( 

scr( l] .name( j  )~inscring(J } ; 

1 

scr(i) .narae[j ]  -  ‘\0* ; 

£scanf(fp,"%dM,&x); 
str( L) .num  -  x; 

for  (j~0;j<6; j++) 
for  (k-0;k<5;k++)( 
for  (1~0;L<5;1++)  ( 
fscanf(fp, H%fM ,&y) ; 
scr( i] . feature (j ) (k) ( l j  -  y; 

) 

) 

) 

fclose(fp) ; 
recurn(h) ; 

J 


128 


/a*******#***}^************************^^*************************.^ 

vrlce£fc£lle(name,scr,l)  /*  used  co  write  updated  DAT  files  co  disk  */ 
char  name ( ]  /*  when  user  Is  done  modifying  che  database  and  selects  */ 

struct  list  str();  /*  menu  option  **  0  (Return  co  main  menu).  */ 
Inc  l;  /^w***^***********************#****************/ 


l 

FILE  *fp,*£open(); 

Inc  j ,k,i.m; 

delete (name) ; 
fp  ~  fopen(name,’,w*') ; 
fprlnt£(£p,M*d\n",l) ; 
for  (j-1;  j<(l+l);  j++)  ( 

fprlncf(fp,  "%-10s%5d  \n",  scr(j).name,  scr(j).num); 
for  (k-0;k<6;k-H-) 
for  (1-0;1<5;1++)  ( 
for  (m-0;m<5;m++) 

fprlncf(fp,  "%3.3£  ",  scr[j ) . feacure(k) (1) (ra)) ; 
fprlntf(fp, M\nM) ; 

) 

) 

fprlncf(£p,  M*M); 
fclose(fp) ; 
return; 

) 
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/A****************************#*#******'*****************************#**/ 


dlsplay(scr,k,m)  /*  m  -  6  or  8  depending  on  w  columns  desired  */ 

scrucc  list  scr{);  /*  m  -  6  for  ilLsc  displays,  8  for  disc  displays  */ 

inc  k,m;  /*  l  -  prescnc  column  being  printed  on  screen  */ 

{  /*  j  counts  by  1  or  A  depending  on  value  of  m  */ 

Inc  j,l,n;  /*  this  is  due  to  format  of  disc  file;  there  are  */ 

l  -  0;  /*  secs  of  A  lines  all  with  the  same  name  and  the  */ 

If  (m  —  6)  l  /*  name  only  needs  to  be  printed  once.  V 

princf("\n\n  The  AFRM  has  the  following  Image  feature  secs:\n"); 
prlncf("  . \n") ; 

1 

else  ( 

princf("  The  AFRM  is  trained  on  the  following  subjects:\n") ; 
prlncf("  . \n"); 


) 

if  (m— 8)  n  -  A; 
else  n  -  1; 

for  (J-l;  j<(k+l) ;  j-j+n)  ( 

1-1+1; 

If  (1  —  m)  { 

1  -  1; 

princf("\n") ; 

) 

If  (ra  —  6)  printf("%llsls%d" ,str(j ) .name,  ,  str(j).num); 
else  princf("dls"  ,str[j  )  .name) ; 

) 

return; 

) 
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copy£ile(src,desc) 


char  src( J ,desc( ) ; 


char  c9 [ 80 ] ; 

c9 ( o }  -  '\0'; 
scrcac(c9,"copy  \0"); 
scrcac(c9,src) ; 

scrcac(c9,"  \0"); 
scrcac(c9 ,desc) ; 
princf("\n  lsM,c9); 
syscem(c9) ; 
re cur n; 

) 

/******************************************************************•**  */ 
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Appendix  E 

mm 
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*********#***********#**********************************$************ 

* 

*  This  is  FACEFT.C 

* 

*  This  is  a  subset  of  FACEDFT  chat  is  concerned  with 

*  the  Fourier  Transform  used  for  the  feacure  sec. 

* 

*  These  routines  use  a  standard  two-  dimensional 

*  Fourier  Transform,  but  calculate  only  the  dc  component 

*  and  the  first  evo  harmonics. 

* 


133 


scaclc  double  ctayc(200)(200),slnaray[5)(3j,cosarny{5)(3j.rinpl65); 
scaclc  Inc  ix.iy; 

/********4***********A**A************A****4ft**rt*^****+***A*********ft*A*/ 
gescalc(ra)  /*  Values  range  from  0  co  128  */ 

Inc  m;  /*  m  **  face  number  */ 

t 

Inc  x.y.i.j ; 
line(256, 0,256, 512,0); 

Une(0, 256, 512, 256,0); 
linc(3S4, 0,384, 512,0); 

Une(l28, 256, 128, 512,0); 

/*  lefc  half:  whole  head  */ 

carea(sx,sy, face(m) .dx/2,face(ra) . dy, 270 ,sy, face(ra) .dx/2, face (m) ,dy) ; 

/*  rlghc  half:  whole  head  */ 

carea(sx+face(m) .dx/2,sy, face(m) .dx/2,face(m) .dy, 

600, sy, face(m) .dx/2, face [m) .dy) ; 

/*  cop  half:  cop  co  cnose  */ 

carea(sx,sy, face(ra) . dx, face (m) .cnose, 15, sy+256,face[m] .dx, face (ra) .cnose) 
• 

/*  Incernal  feacures  */ 

carea(sx+face[ra) . leye, sy+f ace [ra] . ceye, face[m) .reye-face(m) .leye, 

face(«j . cmouch- face (m) .ceye, 

140+face(m] . leye, sy+256+face(m) .ceye, face(ra) .reye-face(m]  .leye, 

face(m) .cmouch-face(ra) . ceye) ; 


/*  lefc  incernal  feacures  */ 

carea(sx+face(m) . leye ,sy+face(m) . ceye, face (m) .cencer-face(m) . Leye, 

face{m) .cmouch- face (m] . ceye, 

270+face(m) . leye, sy+256+face(m] .ceye, face [mj . cencer- face (m) .leye, 

face(m] .cmouch-face(m) .ceye) ; 

/*  boccom  half:  cnose  co  chin  */ 

carea(sx,sy+face[m) .Cnose, face (a) .dx,f’'ce[m) .dy-face(m) .cnose, 

400,sy+256+face[m] . tnose,face[ra] .ux, face(m) .dy-face(m) . cnose) ; 


Line(sx,sy,sx+face[m] .dx,sy,0) ;  /*eop*/ 

line(sx+face(ra) .dx,sy,sx+face(m] .dx,sy+face(m) .dy,0) ;  /*righc*/ 

line(sx+face[raj .dx,sy+face[m) .dy,sx,sy+face[raj .dy,0) ;  /*bottom*/ 

1 ine (sx, sy+f ace [ra] .dy,sx,sy,0) ;  /*lefc*/ 

line(sx,sy+face[raj . teye,sx+face[a) .dx,sy+face[m) . ceye.O) ;  /*teye*/ 

line (sx, sy+f ace [mj .cmouch, sx+face[ra] .dx, sy+f ace [m] . cmouch, 0) ;  /*cmouch*/ 
line(sx,sy+face[mj . tnose,sx+face(ra] .dx,sy+face[m] . Cnose, 0) ;  /*tnose*/ 

line(sx+face[ra] .leye,sy,sx+face[nj . leye, sy+f ace (m) .dy,0) ;  /*leye*/ 

line(sx+face[raj . center ,sy, sx+f ace [m] .center, sy+face[ra] .dy,0) ;  /*center*/ 

line(sx+face[raj .reye.sy, sx+f ace [mj . r eye, sy+f ace (m) .dy,0) ;  /*reye*/ 

ix  -  face(ra) .dx/2; 
iy  -  facejmj .dy/2; 


printf("\n  calculating  fft  for  window  1."); 

clear_cray() ;  /*  left  half:  whole  head  */ 

for  (y-sy;  y<sy+face[m] .dy;  y+-2) 
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for  (x»270;  x<270+facc(ra) .dx/2;  x+-2)  t 

crayr ( (x-269)/2) ( (y-29)/2 ]  -  (double)  brplxel(x,y)/25S; 

J 

fc2 (crayr, l+(x-269)/2, l+(y-29)/2) ; 
save_f f e(0) ; 

prlncf(M\n  calculating  ffc  for  window  2."); 

cloar_cray() ;  /*  right  half:  whole  head  */ 

for  (y-sy;  y<sy+facc(ra) ,dy;  y+-2) 

for  (x«A00;  x<A00+face (raj .dx/2;  x+-2)  ( 

crayr((x-399)/2)((y-29)/2)  -  (double)  brplxol(x,y)/255; 

I 

fc2(crayr, l+(x-399)/2, l+(y-29)/2) ; 
save_fft(l) ; 

prlncf("\n  calculating  ffc  for  window  3."); 

clear_cray() ;  /*  cop  half:  top  to  cnosc  •/ 

for  (y-sy+256;  y<sy+256+face(m) . cnose;  y+-2) 
for  (x-15;  x<l5+face(raj .dx;  x+-2)  { 

crayr( (x-lA)/2) { (y-285)/2)  -  (double)  brplxel(x,y)/255; 

) 

fc2 (crayr, l+(x-14)/2,l+(y-285)/2) ; 
save_fft(2) ; 

prlntf("\n  calculating  fft  for  window  4."); 

clear_cray() ;  /*  Internal  feacures  */ 

for  (y-sy+256;  y<sy+256+face(m) .emouth;  y+-2) 
for  (x-140;  x<140+face(ra) .reye;  x+-2)  ( 

crayr((x-139)/2)((y-285)/2]  -  (double)  brplxel(x,y)/2S5 ; 

) 

ft2(crayr , l+(x-139)/2, l+(y-285)/2) ; 
save__ffc(3) ; 

prlntf("\n  calculating  ffc  for  window  5.M); 

clear_cray() ;  /*  left  Internal  feacures  */ 

for  (y-sy+256;  y<sy+256+face(n] .craouch;  y+-2) 
for  (x-270;  x<270+face(m) .dx/2;  x+-2)  ( 

crayr[ (x-269)/2) ( (y-285)/2]  -  (double)  brplxel(x,y)/255; 

) 

fc2(crayr,l+(x-269)/2,l+(y-285)/2) ; 
save_ffc(4) ; 

printf("\n  calculating  fft  for  window  6.”); 

clear_cray() ;  /*  bottom  half:  tnose  to  chin  */ 

for  (y-sy+256;  y<sy+256+face(m) .dy;  y+-2) 
for  (x-400;  x<A00+face[ra] .dx;  x+-2)  ( 

crayr( (x-399)/2] ( (y-285)/2)  -  (double)  brpixel(x,y)/255; 

) 

ft2(crayr , l+(x-399)/2, l+(y-285)/2) ; 
save_fft(5) ; 

return; 

) 
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/***vwt********vb***********************^*******************************/ 


save_ffc( index) 
Inc  Index; 


( 

Inc  x,y; 

ilisc(O) . fcacure) index) (0) (0)  -  sinaray(O) (0) ; 
ILiscjoj .feacurej index) (0) ( 1)  -  sinaray(O) (1) ; 
ilisc(0 j .feacurej index) joj (2)  -  sinaray(O) (2) ; 
iliscjoj . feacurej index j (0) (3)  -  cosaray(O) (1) ; 
iliscjoj .feacurej index j (0) (4)  -  cosaray(O) (2) ; 
iliscjoj . feacurej index) jljjoj  -  sinaray[l] (0) ; 
ilisc(O). feacucej index) (i)(lj  -  sinaray(i) (1) ; 
iiisc(O) . feacurej index) ( 1) (2)  -  sinaray(l) (2) ; 
iliscjoj.feacurejindexjjlj j3)  -  cosaray(i) (l) ; 
Iliscjoj .feacurej index j  jlj  j^)  -  cosaray(l) (2) ; 
iiisc(O) . feacurej index) (2) [0)  -  sinaray[2) (0) ; 
iliscjoj . feacurej index) (2) (1)  -  *inaray[2) (1) ; 
ilisc{0j. feacurej index) (2) (2)  -  cosaray[2) (0) ; 
iLiscjoj . feacurej index) (2) (3)  -  co*aray(2) (1) ; 
iliscjoj .feacurej index) (2) (4)  -  cosaray(2) (2) ; 
iLiscjoj . feacurej index) (3) (0)  -  slnaray(3) (0) ; 
iliscjoj .feacurej index) (3) (1)  -  sinaray[3) (1) ; 
iliscjoj. feacurelindexj(3j (2)  -  cosaray(3) (0) ; 
iliscjoj .feacurej index j (3) (3j  -  cosaray(3) (l) ; 
iliscjoj .feacurej index) j 3 ) j4)  -  cosaray[3) (2) ; 
tlisc{0] . feacurej index) (4) jo j  -  slnaray(4) (0) ; 
illsc(O) . feacurej index j  j4) [lj  -  sinaray[4) (1) ; 
iliscjoj . feacurej index) (4 J ( 2 ]  -  cosaray(4) (0) ; 
iliscjoj . feacurej index j j*j [ 3 j  -  cosaray[4) [1} ; 
iliscjoj . feacurej index j j4) (4 j  -  cosaray[4) (2) ; 


re cur n; 

) 


/**********************************************************************/ 
clear  cray() 

l 

inc  x,y; 


for  (y-0;  y<200;  y++) 
for  (x-O;  x<200;  x-H-) 
crayr[x) (y)  -  0.0; 
recurn; 

) 
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fc2(raray,fcx,fcy) 
doub  Le  raray ( 200 ] ( 200  J ; 


{ 

inc  t, j ,k,l,x,y, 

foe  (k-0;  k<5;  k++)  { 
for  (1-0;  1<3;  1++)  { 
cosaray(k) (ij  -  0.0; 
slnaray(k) ( 1  j  **  0.0; 
for  (i"0;  Kfex;  i++)  ( 
for  (j-0;  j<fcy;  j++)  { 

cosaray(k) (1)  +-  raray(i.](J)  *  cos(-i.*(k-2)*2*pi/fcx-j*(l*2)*2*pi/fcy) ; 
slnaray(k) (1)  +-  rarayl 1} (j )  *  sin(-i*(k-2)*2*pi/fcx-j*(l-2)*2*pL/fcy) ; 

J 

I 


) 


rccurn; 

1 


/aa*********************  **********ifc*******'*****'*********a***aa#aa*a**a*/ 
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